Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.694964723s
FAIL (2025-10-11 05:57:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.695003606s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.602228206s
FAIL (2025-10-11 05:57:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.602267252s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.66898515s
FAIL (2025-10-11 05:56:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.669023396s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.693013886s
FAIL (2025-10-11 05:55:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.693055657s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.577782473s
FAIL (2025-10-11 05:55:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.577835737s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.61587519s
FAIL (2025-10-11 05:54:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.615902988s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.569933099s
FAIL (2025-10-11 05:53:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.570024236s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.678074367s
FAIL (2025-10-11 05:52:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.678114454s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.506558577s
FAIL (2025-10-11 05:51:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.50658687s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.536512609s
FAIL (2025-10-11 05:51:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.536543378s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.63043233s
FAIL (2025-10-11 05:50:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.63046607s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.441352228s
FAIL (2025-10-11 05:50:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.441390277s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.756585859s
FAIL (2025-10-11 05:50:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.756618877s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.745046223s
FAIL (2025-10-11 05:49:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.745080464s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.698590694s
FAIL (2025-10-11 05:48:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 2.69862327s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001816609s
FAIL (2025-10-11 05:48:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Oct 11 05:47:40.055254219 (424h17m27.858718813s) [upload=373303]: Starting upload
Oct 11 05:47:40.055371579 (424h17m27.858836178s) [upload=373303]: Done starting upload
Oct 11 05:47:40.055530213 (424h17m27.858994814s) [upload=373303]: Uploading segments...
Oct 11 05:47:40.055907401 (424h17m27.859372s) [upload=373303]: Got next segment. Inline: false
Oct 11 05:47:40.055976089 (424h17m27.859440691s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 11 05:47:40.055984637 (424h17m27.859449237s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 11 05:47:40.181531071 (424h17m27.984995662s) [seg_pos={0 0}, upload=373303]: Begin upload segment...
Oct 11 05:47:40.181604847 (424h17m27.985069439s) [seg_pos={0 0}, upload=373303]: Done begin upload segment.
Oct 11 05:47:40.181631343 (424h17m27.985095938s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.181849665 (424h17m27.98531425s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.183272340 (424h17m27.986736933s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.184627526 (424h17m27.988092124s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.186636782 (424h17m27.990101375s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.191260871 (424h17m27.994725455s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.192357584 (424h17m27.995822163s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.193012942 (424h17m27.99647752s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.195498317 (424h17m27.998962902s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.197236780 (424h17m28.000701358s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.198094806 (424h17m28.001559383s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.199819270 (424h17m28.003283853s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.202809197 (424h17m28.006273777s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.204539492 (424h17m28.008004072s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.206315809 (424h17m28.009780387s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.207795417 (424h17m28.011259995s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Uploading piece...
Oct 11 05:47:40.799533510 (424h17m28.602998102s) [upload=373303]: Next returned nil segment
Oct 11 05:47:40.799554733 (424h17m28.603019326s) [upload=373303]: Waiting for error group managing segments...
Oct 11 05:47:40.932436132 (424h17m28.73590071s) [noise=true , address=45.91.116.10:4082 , piece_id=XZYC2BG6PKKZWF3TQNAMZ5ZA6J62QXUGENBUF4KOI3YU2Z5APYQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934677117 (424h17m28.738141719s) [noise=true , address=145.79.227.2:4115 , piece_id=ZU7IKYG567WI7RGA3YFECLVA32A3JOHH34UIE3DNLAG3RPNYNUNQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.934825034 (424h17m28.738289617s) [noise=true , address=45.91.116.13:4154 , piece_id=SDFGEYWEB4SLE2E7TTAOZYAZ2HH6I5OTBS3Z76JFPH32BBVSMC4Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.937975308 (424h17m28.7414399s) [noise=true , address=145.79.227.18:4005 , piece_id=O33WEGLCNM6TVCG2R3ZXOFHFINN2SNDQECIYDQ7DIO6CHLZKIOBA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.940348162 (424h17m28.74381274s) [noise=true , address=145.79.227.17:4971 , piece_id=DFYDWSB4LMGN3H7KIPGJO5DW4UTFUJKMLG7IPMS2EMEFHO4766YA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.941077220 (424h17m28.744541812s) [noise=true , address=77.90.31.15:4698 , piece_id=AMBCX6XTPN4QB2ESSBUPRWCMNLV2RSHHARZ4NPQS6ZXAQQEDGPFA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.942375172 (424h17m28.74583975s) [noise=true , address=77.90.31.21:4878 , piece_id=M6BZPKHAM353IR62HJOMQ2A5DJSBK5YWPSUMQE2FQO3SRPNEANOA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.945457606 (424h17m28.74892219s) [noise=true , address=45.91.116.6:4975 , piece_id=WIHIMSVQO6RPC3TLWPXE5HCEZKJIDNP3QP353232EBE4C7MBY55A, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946056616 (424h17m28.749521209s) [noise=true , address=45.91.116.12:4227 , piece_id=TJFJD6DFDEW6XRJN7A66HY7EMBLUGU6GBPHN7N3KYUTBPKFLVKGQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.946610445 (424h17m28.750075079s) [noise=true , address=45.91.116.11:4119 , piece_id=3XUKPEHJTF744FZ5PSUDLIGE2IO6TRAJUD2EYHNIGUJ7E5YWNFGA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.947249794 (424h17m28.750714387s) [noise=true , address=145.79.227.5:4223 , piece_id=P7FWMJTJKXVRLXMIDMVZT4ORUT4ZJ7EA66TKVWCF3LTGPJDMDZOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.948749048 (424h17m28.752213627s) [noise=true , address=145.79.227.7:4294 , piece_id=LQYOJA4PQCPD47P2L3IIE4R2VNAZCMHXPK2KX7ZQQKXJJMAPBWOQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949308548 (424h17m28.752773126s) [noise=true , address=77.90.31.13:4626 , piece_id=TPAI6FCWQMSDPNWYY3SYDP2THCST56N6QMH63MOLWOWZZ5QGQGVA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: <nil>
Oct 11 05:47:40.949331901 (424h17m28.752796495s) [seg_pos={0 0}, upload=373303]: Segment reached optimal threshold of 13 pieces.
Oct 11 05:47:40.949484204 (424h17m28.752948797s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949499088 (424h17m28.752963691s) [noise=true , address=77.90.31.19:4842 , piece_id=CGGLVAOXFIXPKKAV33V5IRINVP6BQWMKWJW4JJO5W5NB2JRDKIWA, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949632162 (424h17m28.7530968s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949639582 (424h17m28.753104179s) [noise=true , address=45.91.116.10:4081 , piece_id=YVKALOSQXMZ6NLDMXV6Q3YDIH322HMLFB2YKLQZ574T5DE6XHPQQ, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949711218 (424h17m28.753175812s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF
Oct 11 05:47:40.949718784 (424h17m28.753183383s) [noise=true , address=77.90.31.18:4806 , piece_id=HIA2W24TNR3QM63YFBRFXROUSFFJSLARPYJKRI6YFK6RZYZC2E2Q, seg_pos={0 0}, upload=373303]: Long tail cancellation due to optimal threshold
Oct 11 05:47:40.949739158 (424h17m28.753203751s) [seg_pos={0 0}, upload=373303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 11 05:47:40.949819767 (424h17m28.753284359s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 11 05:47:40.949826361 (424h17m28.753290953s) [upload=373303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 11 05:47:41.107281897 (424h17m28.9107465s) [upload=373303]: Done uploading segments...
Oct 11 05:47:41.107310493 (424h17m28.910775089s) [upload=373303]: Upload finished. err: <nil>
Duration: 30.001879721s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
253.056231ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:30:07 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 253.085243ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
705.928152ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:28:53 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 705.96493ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
280.668898ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:28:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 280.694446ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
252.563443ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:27:55 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 252.601879ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
787.52287ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:27:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 787.555803ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
282.74668ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:26:17 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 282.859748ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
298.006883ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:25:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 298.034741ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
203.60251ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:24:23 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 203.629175ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
231.155228ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:23:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 231.179237ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
408.681881ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:22:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 408.716654ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
206.184029ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:21:40 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 206.209266ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
389.575452ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:20:36 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 389.604915ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
223.543983ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:20:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 223.703911ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
321.927809ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:19:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 321.95995ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
210.520527ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:19:30 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 210.544245ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
260.52272ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:18:35 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 260.554074ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
203.574196ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:17:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 203.596437ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
198.175576ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:16:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 198.21809ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
196.718035ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:15:57 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 196.859317ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.818188635s
FAIL (2025-10-11 05:15:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.818217217s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
215.329713ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:15:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 215.349012ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.732359175s
FAIL (2025-10-11 05:15:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.732392386s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.616230768s
FAIL (2025-10-11 05:14:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.616267535s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
198.801002ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:14:48 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 198.816985ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
210.039406ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:14:32 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 210.096663ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
217.101573ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:14:12 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 217.128362ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.68474925s
FAIL (2025-10-11 05:14:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.684768565s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.660602437s
FAIL (2025-10-11 05:13:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.66063273s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
581.308458ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:13:01 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 581.338264ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
225.441483ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:12:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 225.482549ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.785111863s
FAIL (2025-10-11 05:11:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.785147267s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.159616317s
FAIL (2025-10-11 05:11:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.15964376s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
220.739609ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-11 05:11:33 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 220.775036ms
edge
linksharing
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.812295753s
FAIL (2025-10-11 05:10:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.812324374s
edge
gateway
us-select-1
|