Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 428.027221ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:08:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 428.120556ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 876.206262ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:08:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 876.243266ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 906.672259ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:07:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 906.721547ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 936.945615ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:06:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 936.98533ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 499.485853ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:06:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 499.58648ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 504.865961ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:05:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 504.922926ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 937.117238ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:03:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 937.233373ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 440.745512ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:02:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 440.77354ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.013845123s trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:02:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.013877649s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.021171216s trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:01:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.02120144s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 687.279258ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 06:00:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 687.310438ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 915.740712ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:59:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 915.843738ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 927.849302ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:58:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 927.873474ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 457.535756ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:57:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 457.56394ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 900.773976ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:56:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 900.798709ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 970.866642ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:56:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 970.891705ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 855.714086ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:55:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 855.738501ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 918.385506ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:55:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 918.413793ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 432.776344ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:54:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 432.806789ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 848.964545ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:53:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 848.98873ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 915.812842ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:53:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 915.839209ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 966.747954ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:52:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 966.778322ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 950.681808ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:51:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 950.713211ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 950.795013ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:50:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 950.825601ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 767.178302ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:50:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 767.214511ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 889.166691ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:49:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 889.274641ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 982.407803ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:49:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 982.437857ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 911.190265ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:48:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 911.230772ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 601.232976ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:47:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 601.330858ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 945.489535ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:46:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 945.514451ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 416.809242ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:45:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 416.837186ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 413.665698ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:45:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 413.694574ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 916.670023ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:44:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 916.699511ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 911.888875ms trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:44:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 911.917728ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m51.000703164s trace: https://jaeger.dev.storj.io/trace/3ae8fe29db53691a FAIL (2025-12-12 05:44:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece... Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments... Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil> Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces. Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments... Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m51.000728724s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.674797091s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:34:56 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.674827046s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.865523066s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:34:26 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.865549179s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.779093739s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:33:25 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.779116241s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.916448737s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:32:37 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.916488687s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.808406631s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:31:41 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.80844083s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.689045455s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:30:56 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.689070628s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.669326603s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:30:16 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.669420365s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.610825813s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:29:32 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.611079797s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.505079487s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:28:54 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.505178159s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.790148838s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:28:39 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.790256895s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.662213434s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:28:02 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.662316678s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.76057463s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:27:46 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.760603796s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.897046382s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:26:43 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.897140881s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.683500383s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:25:43 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.683552375s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.612074071s trace: https://jaeger.dev.storj.io/trace/4eb32b83ad849777 FAIL (2025-12-11 21:25:28 UTC) orbiter warning: read tcp 139.59.144.22:58036->45.38.24.2:443: read: connection reset by peer Duration: 2.612102056s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)