Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.551774843s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:28:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.551815321s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.628912494s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:27:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.628941158s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.590934926s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:27:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.590963041s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.520537225s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:26:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.520578642s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.934796876s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:26:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.934822012s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.732604773s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:26:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.732630521s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
12.247904552s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:25:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 12.247936779s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.74172383s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:25:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.741751072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
1.623791123s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:25:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.62382175s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.639435766s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:24:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.639472007s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
1.675230389s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:24:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.67527132s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.113572322s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:24:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.113600606s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.655571338s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:23:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.655590245s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
1.711502339s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:23:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.711555515s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
2.092884249s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:22:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.092910231s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.706025525s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.706066801s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
1.586747115s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.586775249s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.661945977s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.661980547s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.740153775s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:20:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.740185462s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.600062312s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:19:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.600089276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.73415136s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:19:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.734188287s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.835988213s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:18:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.836012052s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.591647757s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:17:15 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.591676031s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.818882068s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:16:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.818904173s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
1.59174559s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:15:25 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.5917864s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
1.707287463s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:14:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.707474048s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
1.716033812s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:13:44 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.716059547s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
1.692628394s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:12:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.692643957s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
1.80735515s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:11:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.807390551s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
2.073906095s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:10:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.073932862s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
2.117410002s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:09:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.11743379s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
1.655153112s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:09:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.655176564s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
1.677083485s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:08:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.677127382s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
2.15903684s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:08:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.159229302s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
1.665305721s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:07:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.665330436s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............] duration:
1.748600082s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:06:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.748712129s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............] duration:
1.672308036s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:05:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.672331343s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........] duration:
1.63936669s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:04:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.639529281s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........] duration:
1.799894601s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:03:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.799923867s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........] duration:
1.640944426s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:02:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.640973428s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........] duration:
1.726255745s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:01:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.726319644s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......] duration:
1.757225665s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:00:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.757270495s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
1.912885152s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:59:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.912911802s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
1.750180695s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:59:01 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.750209024s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
1.776053487s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:57:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.776090477s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.66668439s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:57:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.666804838s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
1.672007522s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:56:06 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.672066397s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
1.654499796s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:55:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.654526572s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.001115494s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 16:55:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.001143282s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.26951875s trace:
https://jaeger.dev.storj.io/trace/2a12d3db7e2c86c7
FAIL (2026-02-07 10:42:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.864370673 (546h1m0.748324877s) [noise=true , address=45.91.116.8:4064 , piece_id=FH72KJFPY5FQKHUSNGK5C5TSZ4HBKBHQRSIIKCZHQNFX6A5PBURA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.864603392 (546h1m0.748557598s) [noise=true , address=145.79.227.50:4385 , piece_id=5LNCXYXRTPPGW3B7ZO672CIOCKAB2FPLTPNBMP37HDPK6OFEPW7Q, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.865263458 (546h1m0.749217676s) [noise=true , address=79.127.219.41:4954 , piece_id=I4R57EF6PJUYSLENTHRIX5BU72AZDEFM7ERRZWIVX6JGBRCD52FA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.865496095 (546h1m0.74945031s) [noise=true , address=77.90.31.19:4853 , piece_id=AR5WIVIQ3TBQHJGH62YV7RHIHZAEHRPZY7STJTHEJIEFPXOWOI5Q, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.866052236 (546h1m0.750006454s) [noise=true , address=145.79.227.21:4490 , piece_id=WZSPMQT3RTRUU3G4L6N5EREFB57EFST2SSOJXYEDJCXSYFXFB7BQ, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.866558952 (546h1m0.750513174s) [noise=true , address=79.127.219.38:4833 , piece_id=5US4PZUPDZZCS2IILJ3F5NB5ILSHOT3YBDXRL737FJCUZQ5NMN4Q, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.867063198 (546h1m0.75101742s) [noise=true , address=77.90.31.11:4586 , piece_id=QSVCINC6HUUKNO4MM2SO2GAOECOJ2MAGQ5VHIJBUVYZG5HNKUFCA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.867572480 (546h1m0.751526699s) [noise=true , address=79.127.219.45:4878 , piece_id=ZFIGG6QIHQIY4FOY7T37PUJ6TS6VGCPLJNK6TNE3XFT4MI6RIC4A, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.870318379 (546h1m0.754272584s) [noise=true , address=77.90.31.18:4811 , piece_id=MOSNSWTBHYMGA7DJJJ2OSTSFBB3TBY6WCRKDI7SZJWNCARCIASKA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.870832289 (546h1m0.754786491s) [noise=true , address=145.79.227.37:4588 , piece_id=KIVZU3UIGWQODWKTPQJPQJAMW3NJ72FQ4BP7UJCXJM3C7MXQCAJQ, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.871295262 (546h1m0.755249469s) [noise=true , address=145.79.227.36:4551 , piece_id=44NMJSXJQW5ZC4QSWWFJU5JK4VB5Z4GTNUWPUCTZEIGTFYLW7K2A, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.871786403 (546h1m0.755740613s) [noise=true , address=45.91.116.7:4036 , piece_id=B7X5J22SW62A6Z3VNSPGM3FQCIYXF226ESURG2HXZCJXH4THZ27Q, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.872369548 (546h1m0.756323759s) [noise=true , address=77.90.31.21:4903 , piece_id=7UFXAV4XMJS4JHGOHZ5ILTP2JGWYOX7SUD6WNSA3VM2WFOPBZVPA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.873102498 (546h1m0.757056705s) [noise=true , address=77.90.31.16:4749 , piece_id=RYZKNHNUZZJBQFLPW6FELVVXZ5R7R3235IA5K6WSIEFV5RRPNO3A, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.873746122 (546h1m0.757700379s) [noise=true , address=45.91.116.13:4167 , piece_id=HVP5WN7NK3RAA7PGES4SERKIKFZR36V5XSDR2R2JDEORLAPFYIPQ, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.874201159 (546h1m0.758155354s) [noise=true , address=145.79.227.41:4107 , piece_id=SP6OEHXBVWAYJHG5AAW6C55XR7T3X6TTSY3DJ4BNP227KRRS6MZQ, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:22.875521269 (546h1m0.759475468s) [noise=true , address=77.90.31.15:4713 , piece_id=WCQY6MTKNWCFKP23TR3BPTAO5332XNXMPRWTSPGITJQMNM2SXLTA, seg_pos={0 0}, upload=480578]: Uploading piece...
Feb 7 09:56:23.432975660 (546h1m1.316929868s) [upload=480578]: Next returned nil segment
Feb 7 09:56:23.433021404 (546h1m1.316975609s) [upload=480578]: Waiting for error group managing segments...
Feb 7 09:56:23.566101956 (546h1m1.450056159s) [noise=true , address=79.127.219.46:4896 , piece_id=I2FF2FVML4QKJDA53VZDQ24Y5D6O6TBSCX7E22YVHFDNNWKEVNNA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.567484794 (546h1m1.451438995s) [noise=true , address=145.79.227.50:4385 , piece_id=5LNCXYXRTPPGW3B7ZO672CIOCKAB2FPLTPNBMP37HDPK6OFEPW7Q, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.567610773 (546h1m1.451564984s) [noise=true , address=79.127.219.41:4954 , piece_id=I4R57EF6PJUYSLENTHRIX5BU72AZDEFM7ERRZWIVX6JGBRCD52FA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.574947459 (546h1m1.458901658s) [noise=true , address=77.90.31.15:4713 , piece_id=WCQY6MTKNWCFKP23TR3BPTAO5332XNXMPRWTSPGITJQMNM2SXLTA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.579850751 (546h1m1.463804951s) [noise=true , address=145.79.227.37:4588 , piece_id=KIVZU3UIGWQODWKTPQJPQJAMW3NJ72FQ4BP7UJCXJM3C7MXQCAJQ, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.583238739 (546h1m1.467192939s) [noise=true , address=77.90.31.18:4811 , piece_id=MOSNSWTBHYMGA7DJJJ2OSTSFBB3TBY6WCRKDI7SZJWNCARCIASKA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.587085541 (546h1m1.471039749s) [noise=true , address=77.90.31.11:4586 , piece_id=QSVCINC6HUUKNO4MM2SO2GAOECOJ2MAGQ5VHIJBUVYZG5HNKUFCA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.588437159 (546h1m1.472391358s) [noise=true , address=77.90.31.21:4903 , piece_id=7UFXAV4XMJS4JHGOHZ5ILTP2JGWYOX7SUD6WNSA3VM2WFOPBZVPA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.589884195 (546h1m1.473838394s) [noise=true , address=45.91.116.8:4064 , piece_id=FH72KJFPY5FQKHUSNGK5C5TSZ4HBKBHQRSIIKCZHQNFX6A5PBURA, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.591072344 (546h1m1.475026544s) [noise=true , address=77.90.31.16:4749 , piece_id=RYZKNHNUZZJBQFLPW6FELVVXZ5R7R3235IA5K6WSIEFV5RRPNO3A, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.597621147 (546h1m1.481575348s) [noise=true , address=79.127.219.45:4878 , piece_id=ZFIGG6QIHQIY4FOY7T37PUJ6TS6VGCPLJNK6TNE3XFT4MI6RIC4A, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.598428992 (546h1m1.48238319s) [noise=true , address=145.79.227.21:4490 , piece_id=WZSPMQT3RTRUU3G4L6N5EREFB57EFST2SSOJXYEDJCXSYFXFB7BQ, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.598865749 (546h1m1.482819948s) [noise=true , address=45.91.116.7:4036 , piece_id=B7X5J22SW62A6Z3VNSPGM3FQCIYXF226ESURG2HXZCJXH4THZ27Q, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.608188458 (546h1m1.492142666s) [noise=true , address=45.91.116.13:4167 , piece_id=HVP5WN7NK3RAA7PGES4SERKIKFZR36V5XSDR2R2JDEORLAPFYIPQ, seg_pos={0 0}, upload=480578]: Done uploading piece. err: <nil>
Feb 7 09:56:23.608218997 (546h1m1.492173207s) [seg_pos={0 0}, upload=480578]: Satisfied cohort requirements after 14 pieces
Feb 7 09:56:23.608464987 (546h1m1.492419199s) [noise=true , address=145.79.227.36:4551 , piece_id=44NMJSXJQW5ZC4QSWWFJU5JK4VB5Z4GTNUWPUCTZEIGTFYLW7K2A, seg_pos={0 0}, upload=480578]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UhJvSMtNqJDak4TM7eUgz1N7yCn4ChmRRTe7nXdffTNsS1pch): protocol: expected piece hash; context canceled; EOF
Feb 7 09:56:23.608476247 (546h1m1.492430456s) [noise=true , address=145.79.227.36:4551 , piece_id=44NMJSXJQW5ZC4QSWWFJU5JK4VB5Z4GTNUWPUCTZEIGTFYLW7K2A, seg_pos={0 0}, upload=480578]: Long tail cancellation due to optimal threshold
Feb 7 09:56:23.609065110 (546h1m1.493019319s) [noise=true , address=79.127.219.38:4833 , piece_id=5US4PZUPDZZCS2IILJ3F5NB5ILSHOT3YBDXRL737FJCUZQ5NMN4Q, seg_pos={0 0}, upload=480578]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PiFH6KvBR88kTE9NJzFZ9DAKjNNc4ZJrtg6ArnubWqL1muf1F): protocol: expected piece hash; context canceled; EOF
Feb 7 09:56:23.609079553 (546h1m1.493033763s) [noise=true , address=79.127.219.38:4833 , piece_id=5US4PZUPDZZCS2IILJ3F5NB5ILSHOT3YBDXRL737FJCUZQ5NMN4Q, seg_pos={0 0}, upload=480578]: Long tail cancellation due to optimal threshold
Feb 7 09:56:23.609245739 (546h1m1.493199949s) [noise=true , address=145.79.227.41:4107 , piece_id=SP6OEHXBVWAYJHG5AAW6C55XR7T3X6TTSY3DJ4BNP227KRRS6MZQ, seg_pos={0 0}, upload=480578]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YVUtzGaKXr1Leb1URHZuaQXZv4zTtYwnv59j5GaAfd9zoK2Kj): protocol: expected piece hash; context canceled; EOF
Feb 7 09:56:23.609252810 (546h1m1.49320708s) [noise=true , address=145.79.227.41:4107 , piece_id=SP6OEHXBVWAYJHG5AAW6C55XR7T3X6TTSY3DJ4BNP227KRRS6MZQ, seg_pos={0 0}, upload=480578]: Long tail cancellation due to optimal threshold
Feb 7 09:56:23.609415564 (546h1m1.493369772s) [noise=true , address=77.90.31.19:4853 , piece_id=AR5WIVIQ3TBQHJGH62YV7RHIHZAEHRPZY7STJTHEJIEFPXOWOI5Q, seg_pos={0 0}, upload=480578]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WBuBdGxdPXi6VsNf4FJpn3LpWoQztM7CV6YjAW1mUDVjAUjn2): protocol: expected piece hash; context canceled; EOF
Feb 7 09:56:23.609424075 (546h1m1.493378287s) [noise=true , address=77.90.31.19:4853 , piece_id=AR5WIVIQ3TBQHJGH62YV7RHIHZAEHRPZY7STJTHEJIEFPXOWOI5Q, seg_pos={0 0}, upload=480578]: Long tail cancellation due to optimal threshold
Feb 7 09:56:23.609465779 (546h1m1.493419978s) [seg_pos={0 0}, upload=480578]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 7 09:56:23.609576450 (546h1m1.49353065s) [upload=480578]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 7 09:56:23.609583434 (546h1m1.49353764s) [upload=480578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 7 09:58:03.178825489 (546h2m41.062779721s) [upload=480578]: Done uploading segments...
Feb 7 09:58:03.178997209 (546h2m41.062951433s) [upload=480578]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.269542005s
core
uplink
us-select-1
us1-placement-20
|