Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.459038126s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:48:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.459067112s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.488365686s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:47:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.488394995s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.447380891s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:46:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.447429935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.470673953s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:45:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.470703962s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.456465105s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:44:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.45649356s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.389040541s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:43:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.38911841s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.483913281s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:43:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.483942647s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.343364971s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:41:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.343432307s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.383402991s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:40:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.383460674s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.43195828s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:39:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.431999801s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.406255911s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:39:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.406494294s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.47110899s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:38:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 2.471136369s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002853591s trace:
https://jaeger.dev.storj.io/trace/40150cfcfd7e63e0
FAIL (2026-02-12 21:38:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy, Piece ID: 4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA) context deadline exceeded; piecestore: (Node ID: 12YEVsEwZwfWsnZFyaSkd9Dn53Tb9EFUyWEVDwTQeMJkcjwrj7x, Piece ID: SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A) context deadline exceeded; piecestore: (Node ID: 12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, Piece ID: JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA) context deadline exceeded; piecestore: (Node ID: 19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, Piece ID: JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ) context deadline exceeded; piecestore: (Node ID: 1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, Piece ID: FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q) context deadline exceeded; piecestore: (Node ID: 1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, Piece ID: RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ) context deadline exceeded
======LOGS======
435517288s) [upload=50547]: Uploading segments...
Feb 12 21:38:14.002584088 (57h23m14.435846278s) [upload=50547]: Got next segment. Inline: false
Feb 12 21:38:14.002676626 (57h23m14.43593878s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 12 21:38:14.002684892 (57h23m14.435947022s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 12 21:38:14.116829594 (57h23m14.550091747s) [seg_pos={0 0}, upload=50547]: Begin upload segment...
Feb 12 21:38:14.116924460 (57h23m14.550186572s) [seg_pos={0 0}, upload=50547]: Done begin upload segment.
Feb 12 21:38:14.116946106 (57h23m14.550208232s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117138421 (57h23m14.550400547s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.117794188 (57h23m14.551056324s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.118335993 (57h23m14.55159814s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119340762 (57h23m14.552602896s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.119764540 (57h23m14.553026668s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120198405 (57h23m14.553460532s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.120697148 (57h23m14.553959273s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.121410403 (57h23m14.554672538s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122127071 (57h23m14.555389199s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.122677467 (57h23m14.555939592s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.124387365 (57h23m14.557649497s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.126253889 (57h23m14.55951602s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.128444349 (57h23m14.561706477s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.130234388 (57h23m14.563496519s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.131765784 (57h23m14.565027925s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Uploading piece...
Feb 12 21:38:14.716427455 (57h23m15.14968959s) [upload=50547]: Next returned nil segment
Feb 12 21:38:14.716446821 (57h23m15.149708956s) [upload=50547]: Waiting for error group managing segments...
Feb 12 21:38:14.846725705 (57h23m15.279987843s) [noise=true , address=77.90.31.13:4627 , piece_id=RDLX3XN6256R4H5ARNY6ERZSBHFSDYXRV7QYAGOLW4SFJMOJNLXQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.883514541 (57h23m15.316776673s) [noise=true , address=77.90.31.10:4517 , piece_id=MURNJXAXHNETMTFGQYJSMZM5KOINIB4ZN5LPDQMFQBZATROXZR7Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:14.897566468 (57h23m15.330828593s) [noise=true , address=79.127.219.41:4925 , piece_id=WJKWGIDLA3MVZMUJ32CJEAW6AQE5X2QD62YPJZIEARB7F52Y7EMQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.006318993 (57h23m15.439581181s) [noise=true , address=79.127.219.38:4822 , piece_id=VBSOEA27PC4ZIUA64LGWNIZF6JMBE67JHWPM77DA2WZ5GB5ILCTA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.507295907 (57h23m15.940558044s) [noise=true , address=145.79.227.19:4082 , piece_id=GKKRKVBAVVJPNX6OLB7R5UXFGLSHPASZEQXVVNMMW45ELHJKU6MQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:15.560742983 (57h23m15.994005108s) [noise=true , address=145.79.227.3:4154 , piece_id=HA37NSGFZQRLWH7ETAXIWFWTMCEY73X5XU2RBGFMGENZSBAPQ2FA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:16.194465369 (57h23m16.627727495s) [noise=true , address=145.79.227.7:4297 , piece_id=FXP7ZKUZIXRGFWQTOYSAQV3TVMAWXTPA4CESTRHBUSHVUJ7LM64Q, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:17.158722003 (57h23m17.591984127s) [noise=true , address=145.79.227.50:4379 , piece_id=JFFZMMU4YN4LBC25ZJZQZDHKA4YAOIWA6ARVRAC5YRLJ3WHEROZQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:36.622501269 (57h23m37.055763381s) [noise=true , address=145.79.227.35:4485 , piece_id=JE436GWUI5FW3FZIBPBHKOQKVNPFSN7EMRNPTTKKDF4OWV4LCEKA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:39.328146131 (57h23m39.761408267s) [noise=true , address=145.79.227.36:4520 , piece_id=4PYAT622CP4M6NVIY3KKN44CDED3G7DN5BMJ6GGWTT7MZ3BFPGQA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:40.486408635 (57h23m40.919670774s) [noise=true , address=145.79.227.25:4621 , piece_id=W2ASV4KBBKE5HAYTO4ZJPJ6EKH2J3WMY5II6S2NU5XACSLHC64YQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:42.732720561 (57h23m43.165982686s) [noise=true , address=145.79.227.13:4805 , piece_id=SE2AMRFTBR2PCQRUJ76IZD6MXLNKOV6BFVHQDYNFIOAW66GZTT7A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.005976134 (57h23m43.439238259s) [noise=true , address=145.79.227.23:4548 , piece_id=JEMBCTMY36VVD7BGIDLSRPPBGGAEJL3BBFPZQKLKTYE7KBF3IWTQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: <nil>
Feb 12 21:38:43.006002803 (57h23m43.439265001s) [seg_pos={0 0}, upload=50547]: Satisfied cohort requirements after 13 pieces
Feb 12 21:38:43.006267808 (57h23m43.439529943s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42070->145.79.227.52:4450: use of closed network connection
Feb 12 21:38:43.006279373 (57h23m43.439541508s) [noise=true , address=145.79.227.52:4450 , piece_id=ZP7SGNOBEC3L7R4TOXKRAHY7URSSJ3KXQGGIXTXUSBNXK443TEGA, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006294630 (57h23m43.439556778s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53122->145.79.227.26:4657: use of closed network connection
Feb 12 21:38:43.006325887 (57h23m43.439588017s) [noise=true , address=145.79.227.26:4657 , piece_id=QLAKD2TELXRWBKXOTGMMW4E7WWDEK52EJ5K25JNMW3S474M5EQUQ, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006665522 (57h23m43.439927656s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: write tcp 139.59.144.22:55994->145.79.227.38:4977: use of closed network connection; context canceled
Feb 12 21:38:43.006676662 (57h23m43.439938787s) [noise=true , address=145.79.227.38:4977 , piece_id=N76T57LIUHGZA5OQXE5AFF4AKUWGN7WZGJXVKQCZEBG5MH6KQB5A, seg_pos={0 0}, upload=50547]: Long tail cancellation due to optimal threshold
Feb 12 21:38:43.006697807 (57h23m43.439959922s) [seg_pos={0 0}, upload=50547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 12 21:38:43.006774081 (57h23m43.440036206s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 12 21:38:43.006779257 (57h23m43.440041382s) [upload=50547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 12 21:38:43.143421669 (57h23m43.576683785s) [upload=50547]: Done uploading segments...
Feb 12 21:38:43.143453083 (57h23m43.576715208s) [upload=50547]: Upload finished. err: <nil>
Duration: 30.002879508s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.033031051s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:23:22 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.033046609s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.919383847s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:22:23 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.91941048s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.046175277s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:21:48 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.046196775s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.137751734s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:20:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.137784425s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
3.354170031s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:19:38 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.35421021s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
3.106903607s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:19:03 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.106940872s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.112880357s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:18:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.112901276s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
3.128470382s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:17:57 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.128514405s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.911341486s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:17:37 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.911377837s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
3.00127189s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:17:00 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.001306277s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
3.129384716s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:16:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.129413919s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
3.006528289s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:15:59 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.006559137s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.947261435s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:15:33 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.94728946s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
3.223009179s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:14:22 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.223038115s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
3.058326941s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:13:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.058355955s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
3.02241465s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:12:51 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.022441441s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.853308289s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:12:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.853350629s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
3.070555402s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:11:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.070586541s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.840821203s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:11:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.840848576s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
3.000278646s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:10:39 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.000309877s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.07389836s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:09:53 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.073928587s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
3.16154284s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:08:54 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.161568531s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.054328995s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:08:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.05436846s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.648634315s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:08:00 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.648672333s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
3.351885011s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:06:57 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.351907185s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.288964231s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:06:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.288993854s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
3.043969194s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:05:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.043996656s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
3.006925014s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:05:12 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.007007212s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
3.473372437s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:04:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.473403836s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.929348481s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:03:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.929382661s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.93597946s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:03:25 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.93599853s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.930683033s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:02:33 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.930719697s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.900502736s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:01:49 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.900534762s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
3.009143118s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:00:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.009171765s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.218099853s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 19:00:06 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.218198129s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.109661403s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 18:59:08 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.109696243s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.843300475s trace:
https://jaeger.dev.storj.io/trace/61f98525de70b56d
FAIL (2026-02-12 18:58:08 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.843330958s
core
uplink
ap1
|