Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
224.185598ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:42:17 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 224.21852ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
305.389993ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:41:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 305.418283ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
197.221595ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:40:52 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 197.339888ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
273.615295ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:39:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 273.643964ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
205.043116ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:38:39 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 205.0832ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
211.219082ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 08:37:44 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 211.295023ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.537532747s
FAIL (2025-10-11 06:29:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.537570018s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.606034361s
FAIL (2025-10-11 06:28:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.606080336s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.548580628s
FAIL (2025-10-11 06:28:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.548620235s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.427429419s
FAIL (2025-10-11 06:28:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.427464886s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.52585433s
FAIL (2025-10-11 06:27:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.525881694s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.821502818s
FAIL (2025-10-11 06:26:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.821539494s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.550776483s
FAIL (2025-10-11 06:25:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.550808742s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.576090921s
FAIL (2025-10-11 06:25:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.576129833s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.454031495s
FAIL (2025-10-11 06:24:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.454074835s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.471794904s
FAIL (2025-10-11 06:23:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.471820541s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.564269724s
FAIL (2025-10-11 06:22:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.564298876s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.531176906s
FAIL (2025-10-11 06:22:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.531208497s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.614741697s
FAIL (2025-10-11 06:21:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.614769752s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.611613701s
FAIL (2025-10-11 06:20:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.611647755s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.463950936s
FAIL (2025-10-11 06:20:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.463987267s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.533747115s
FAIL (2025-10-11 06:19:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.533776882s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.581846386s
FAIL (2025-10-11 06:18:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.58199724s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.517753033s
FAIL (2025-10-11 06:17:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.517785435s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.584980567s
FAIL (2025-10-11 06:16:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.585018047s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.605355211s
FAIL (2025-10-11 06:15:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.605415554s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.544969941s
FAIL (2025-10-11 06:14:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.544999698s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.599468854s
FAIL (2025-10-11 06:13:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.599512331s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.562001561s
FAIL (2025-10-11 06:12:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.562039426s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.618801599s
FAIL (2025-10-11 06:12:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.618928803s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.490173795s
FAIL (2025-10-11 06:11:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.490211114s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.424697265s
FAIL (2025-10-11 06:11:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.424748046s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.567443032s
FAIL (2025-10-11 06:10:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.567494216s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.494297955s
FAIL (2025-10-11 06:09:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.494333655s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.795046639s
FAIL (2025-10-11 06:09:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.795088143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.921867388s
FAIL (2025-10-11 06:08:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.921904466s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.554823809s
FAIL (2025-10-11 06:07:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.55485345s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.644705432s
FAIL (2025-10-11 06:07:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.644739553s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.434496584s
FAIL (2025-10-11 06:06:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.43452642s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.718285074s
FAIL (2025-10-11 06:05:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.718331136s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.736793859s
FAIL (2025-10-11 06:05:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.736840148s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.602829906s
FAIL (2025-10-11 06:04:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.602860151s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.686203864s
FAIL (2025-10-11 06:03:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.686237034s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.764830476s
FAIL (2025-10-11 06:02:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.764853967s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.539888426s
FAIL (2025-10-11 06:02:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.539924003s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.415250893s
FAIL (2025-10-11 06:01:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.415281392s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.822194753s
FAIL (2025-10-11 06:00:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.82229763s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.541481121s
FAIL (2025-10-11 05:59:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.54151917s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.734496534s
FAIL (2025-10-11 05:59:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.734532603s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.537369638s
FAIL (2025-10-11 05:58:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.537467087s
core
uplink
us-select-1
|