Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.51331487s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 22:00:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.513347635s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.468520929s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 22:00:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.468551514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.457183156s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:59:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.457216975s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.4545373s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:59:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.454566586s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.474159544s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:58:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.474187938s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.447958606s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:57:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.448024276s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.357632253s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:56:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.357660963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.378610888s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:55:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.378636008s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.525018648s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:55:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.525045324s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.350402623s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:54:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.350443217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.43542284s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:53:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.435450516s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.428184581s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:52:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.428202064s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.459903657s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:51:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.459931027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.453580967s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:51:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.453613331s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.457159281s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:50:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.457186649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.442532271s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:49:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.442560158s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.468760673s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:48:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.468789156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.459038126s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:48:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.459067112s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.488365686s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:47:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.488394995s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.447380891s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:46:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.447429935s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.470673953s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:45:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.470703962s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.456465105s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:44:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.45649356s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.389040541s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:43:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.38911841s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.483913281s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:43:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.483942647s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.343364971s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:41:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.343432307s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.383402991s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:40:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.383460674s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.43195828s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:39:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.431999801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.406255911s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:39:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.406494294s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.47110899s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:38:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 2.471136369s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002853591s trace: https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0 FAIL (2026-02-12 21:38:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded ======LOGS====== 435517288s) [upload=50547]: Uploading segments... Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment... Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment. Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece... Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments... Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil> Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments... Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil> Duration: 30.002879508s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 3.033031051s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:23:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.033046609s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.919383847s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:22:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.91941048s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.046175277s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:21:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.046196775s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.137751734s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:20:36 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.137784425s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.354170031s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:19:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.35421021s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 3.106903607s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:19:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.106940872s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 3.112880357s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:18:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.112901276s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 3.128470382s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:17:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.128514405s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.911341486s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:17:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.911377837s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.00127189s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:17:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.001306277s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 3.129384716s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:16:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.129413919s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 3.006528289s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:15:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.006559137s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.947261435s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:15:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.94728946s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 3.223009179s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:14:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.223038115s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 3.058326941s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:13:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.058355955s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.02241465s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:12:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.022441441s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.853308289s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:12:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.853350629s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.070555402s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:11:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.070586541s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.840821203s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:11:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.840848576s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.000278646s trace: https://jaeger.dev.storj.io/trace/61f98525de70b56d FAIL (2026-02-12 19:10:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.000309877s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)