Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 353969 reports (Page 556 of 7080)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [.................................X....X.XXXX.XXX...XXXX.....]
duration:
2.019645509s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:58:01 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 2.019674974s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
3.685931477s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:58:00 UTC)
orbiter warning: context deadline exceeded
Duration: 3.685961373s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [..............................XX.....XXX..X..XXX.XXXX.XX....]
duration:
2.388434969s
trace:
https://jaeger.dev.storj.io/trace/75e0f0868fd0d72
FAIL (2026-03-18 21:57:52 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:54:18.149554843 (197h43m21.165224435s) [upload=189883]: Starting upload
Mar 18 21:54:18.149629705 (197h43m21.165299296s) [upload=189883]: Done starting upload
Mar 18 21:54:18.149726090 (197h43m21.16539568s) [upload=189883]: Uploading segments...
Mar 18 21:54:18.149968905 (197h43m21.165638498s) [upload=189883]: Got next segment. Inline: false
Mar 18 21:54:18.150024167 (197h43m21.165693769s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:54:18.150031397 (197h43m21.165700997s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:26.308528312 (197h43m29.324197912s) [seg_pos={0 0}, upload=189883]: Begin upload segment...
Mar 18 21:54:26.308650989 (197h43m29.324320588s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.309947151 (197h43m29.325616759s) [seg_pos={0 0}, upload=189883]: Done begin upload segment.
Mar 18 21:54:26.310024877 (197h43m29.325694487s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.310648388 (197h43m29.326318s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.311260449 (197h43m29.32693006s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.312476969 (197h43m29.328146592s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.313742039 (197h43m29.329411642s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.314129731 (197h43m29.32979934s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.315306083 (197h43m29.330975691s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.316537735 (197h43m29.332207343s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.317296012 (197h43m29.332965624s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.318422029 (197h43m29.334091636s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.319037770 (197h43m29.334707382s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.320223299 (197h43m29.335892922s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321492900 (197h43m29.337162507s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321765536 (197h43m29.337435143s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.323594932 (197h43m29.339264544s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.935519647 (197h43m29.951189247s) [upload=189883]: Next returned nil segment
Mar 18 21:54:26.935535154 (197h43m29.951204754s) [upload=189883]: Waiting for error group managing segments...
Mar 18 21:54:27.064763826 (197h43m30.080433427s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066336450 (197h43m30.08200605s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066710529 (197h43m30.082380129s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067163041 (197h43m30.082832641s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067539264 (197h43m30.083208864s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067890346 (197h43m30.08355995s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.068825983 (197h43m30.084495583s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071631864 (197h43m30.087301453s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071767013 (197h43m30.087436614s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.072116600 (197h43m30.0877862s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.073662705 (197h43m30.089332313s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.081111494 (197h43m30.096781094s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085500985 (197h43m30.101170602s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085522039 (197h43m30.10119164s) [seg_pos={0 0}, upload=189883]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:27.086116447 (197h43m30.101786058s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086202338 (197h43m30.101871943s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086610013 (197h43m30.102279622s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086645950 (197h43m30.10231555s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086923172 (197h43m30.102592787s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hV2HLvT4YUVqeM2eAVe8p8UFVsZK7MYN95YinC8KMss9sKDXt): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086949914 (197h43m30.102619517s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.087062900 (197h43m30.10273249s) [seg_pos={0 0}, upload=189883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:54:27.087234507 (197h43m30.102904107s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:27.087240800 (197h43m30.1029104s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:39.677837110 (197h43m42.693506704s) [upload=189883]: Done uploading segments...
Mar 18 21:54:39.677859307 (197h43m42.693528908s) [upload=189883]: Upload finished. err: <nil>
Duration: 2.388487812s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
49 out of 60 is failed (threshold=6) [XXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX....]
duration:
2.458135205s
trace:
https://jaeger.dev.storj.io/trace/2c02709149f42d48
FAIL (2026-03-18 21:57:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.458229178s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [................................XX....XXXXXX..XX.XXXXXXX....]
duration:
906.733661ms
trace:
https://jaeger.dev.storj.io/trace/1e14c800e54addc9
FAIL (2026-03-18 21:57:44 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 906.762366ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [.....................................XXX..XX.XX..XX.........]
duration:
904.015656ms
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:57:41 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 904.104834ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
50 out of 60 is failed (threshold=6) [XXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX...]
duration:
1.846663633s
trace:
https://jaeger.dev.storj.io/trace/2c02709149f42d48
FAIL (2026-03-18 21:57:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.846689887s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [..................................X....X.XXXX.XXX...XXXX....]
duration:
2.327904705s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:57:23 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 2.327934119s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
51 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX..]
duration:
4.606180475s
trace:
https://jaeger.dev.storj.io/trace/2c02709149f42d48
FAIL (2026-03-18 21:57:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.606280626s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
2.818244937s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:56:57 UTC)
orbiter warning: context deadline exceeded
Duration: 2.818260547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [...............................XX.....XXX..X..XXX.XXXX.XX...]
duration:
2.388699276s
trace:
https://jaeger.dev.storj.io/trace/75e0f0868fd0d72
FAIL (2026-03-18 21:56:44 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:54:18.149554843 (197h43m21.165224435s) [upload=189883]: Starting upload
Mar 18 21:54:18.149629705 (197h43m21.165299296s) [upload=189883]: Done starting upload
Mar 18 21:54:18.149726090 (197h43m21.16539568s) [upload=189883]: Uploading segments...
Mar 18 21:54:18.149968905 (197h43m21.165638498s) [upload=189883]: Got next segment. Inline: false
Mar 18 21:54:18.150024167 (197h43m21.165693769s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:54:18.150031397 (197h43m21.165700997s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:26.308528312 (197h43m29.324197912s) [seg_pos={0 0}, upload=189883]: Begin upload segment...
Mar 18 21:54:26.308650989 (197h43m29.324320588s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.309947151 (197h43m29.325616759s) [seg_pos={0 0}, upload=189883]: Done begin upload segment.
Mar 18 21:54:26.310024877 (197h43m29.325694487s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.310648388 (197h43m29.326318s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.311260449 (197h43m29.32693006s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.312476969 (197h43m29.328146592s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.313742039 (197h43m29.329411642s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.314129731 (197h43m29.32979934s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.315306083 (197h43m29.330975691s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.316537735 (197h43m29.332207343s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.317296012 (197h43m29.332965624s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.318422029 (197h43m29.334091636s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.319037770 (197h43m29.334707382s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.320223299 (197h43m29.335892922s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321492900 (197h43m29.337162507s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321765536 (197h43m29.337435143s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.323594932 (197h43m29.339264544s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.935519647 (197h43m29.951189247s) [upload=189883]: Next returned nil segment
Mar 18 21:54:26.935535154 (197h43m29.951204754s) [upload=189883]: Waiting for error group managing segments...
Mar 18 21:54:27.064763826 (197h43m30.080433427s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066336450 (197h43m30.08200605s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066710529 (197h43m30.082380129s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067163041 (197h43m30.082832641s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067539264 (197h43m30.083208864s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067890346 (197h43m30.08355995s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.068825983 (197h43m30.084495583s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071631864 (197h43m30.087301453s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071767013 (197h43m30.087436614s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.072116600 (197h43m30.0877862s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.073662705 (197h43m30.089332313s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.081111494 (197h43m30.096781094s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085500985 (197h43m30.101170602s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085522039 (197h43m30.10119164s) [seg_pos={0 0}, upload=189883]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:27.086116447 (197h43m30.101786058s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086202338 (197h43m30.101871943s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086610013 (197h43m30.102279622s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086645950 (197h43m30.10231555s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086923172 (197h43m30.102592787s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hV2HLvT4YUVqeM2eAVe8p8UFVsZK7MYN95YinC8KMss9sKDXt): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086949914 (197h43m30.102619517s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.087062900 (197h43m30.10273249s) [seg_pos={0 0}, upload=189883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:54:27.087234507 (197h43m30.102904107s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:27.087240800 (197h43m30.1029104s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:39.677837110 (197h43m42.693506704s) [upload=189883]: Done uploading segments...
Mar 18 21:54:39.677859307 (197h43m42.693528908s) [upload=189883]: Upload finished. err: <nil>
Duration: 2.388730356s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [.................................XX....XXXXXX..XX.XXXXXXX...]
duration:
923.758081ms
trace:
https://jaeger.dev.storj.io/trace/1e14c800e54addc9
FAIL (2026-03-18 21:56:39 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 923.786975ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [...................................X....X.XXXX.XXX...XXXX...]
duration:
2.172724883s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:56:29 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 2.172751955s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [......................................XXX..XX.XX..XX........]
duration:
1.016448945s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:56:27 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 1.016486711s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [..................................XX....XXXXXX..XX.XXXXXXX..]
duration:
912.205159ms
trace:
https://jaeger.dev.storj.io/trace/1e14c800e54addc9
FAIL (2026-03-18 21:56:20 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 912.232319ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [.......................................XXX..XX.XX..XX.......]
duration:
932.287423ms
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:56:04 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 932.327406ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
2.745685795s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:56:01 UTC)
orbiter warning: context deadline exceeded
Duration: 2.745721824s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
52 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX.]
duration:
2.443861479s
trace:
https://jaeger.dev.storj.io/trace/2c02709149f42d48
FAIL (2026-03-18 21:55:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.444385472s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [................................XX.....XXX..X..XXX.XXXX.XX..]
duration:
2.303066758s
trace:
https://jaeger.dev.storj.io/trace/75e0f0868fd0d72
FAIL (2026-03-18 21:55:54 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:54:18.149554843 (197h43m21.165224435s) [upload=189883]: Starting upload
Mar 18 21:54:18.149629705 (197h43m21.165299296s) [upload=189883]: Done starting upload
Mar 18 21:54:18.149726090 (197h43m21.16539568s) [upload=189883]: Uploading segments...
Mar 18 21:54:18.149968905 (197h43m21.165638498s) [upload=189883]: Got next segment. Inline: false
Mar 18 21:54:18.150024167 (197h43m21.165693769s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:54:18.150031397 (197h43m21.165700997s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:26.308528312 (197h43m29.324197912s) [seg_pos={0 0}, upload=189883]: Begin upload segment...
Mar 18 21:54:26.308650989 (197h43m29.324320588s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.309947151 (197h43m29.325616759s) [seg_pos={0 0}, upload=189883]: Done begin upload segment.
Mar 18 21:54:26.310024877 (197h43m29.325694487s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.310648388 (197h43m29.326318s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.311260449 (197h43m29.32693006s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.312476969 (197h43m29.328146592s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.313742039 (197h43m29.329411642s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.314129731 (197h43m29.32979934s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.315306083 (197h43m29.330975691s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.316537735 (197h43m29.332207343s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.317296012 (197h43m29.332965624s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.318422029 (197h43m29.334091636s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.319037770 (197h43m29.334707382s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.320223299 (197h43m29.335892922s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321492900 (197h43m29.337162507s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321765536 (197h43m29.337435143s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.323594932 (197h43m29.339264544s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.935519647 (197h43m29.951189247s) [upload=189883]: Next returned nil segment
Mar 18 21:54:26.935535154 (197h43m29.951204754s) [upload=189883]: Waiting for error group managing segments...
Mar 18 21:54:27.064763826 (197h43m30.080433427s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066336450 (197h43m30.08200605s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066710529 (197h43m30.082380129s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067163041 (197h43m30.082832641s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067539264 (197h43m30.083208864s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067890346 (197h43m30.08355995s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.068825983 (197h43m30.084495583s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071631864 (197h43m30.087301453s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071767013 (197h43m30.087436614s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.072116600 (197h43m30.0877862s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.073662705 (197h43m30.089332313s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.081111494 (197h43m30.096781094s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085500985 (197h43m30.101170602s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085522039 (197h43m30.10119164s) [seg_pos={0 0}, upload=189883]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:27.086116447 (197h43m30.101786058s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086202338 (197h43m30.101871943s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086610013 (197h43m30.102279622s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086645950 (197h43m30.10231555s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086923172 (197h43m30.102592787s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hV2HLvT4YUVqeM2eAVe8p8UFVsZK7MYN95YinC8KMss9sKDXt): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086949914 (197h43m30.102619517s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.087062900 (197h43m30.10273249s) [seg_pos={0 0}, upload=189883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:54:27.087234507 (197h43m30.102904107s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:27.087240800 (197h43m30.1029104s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:39.677837110 (197h43m42.693506704s) [upload=189883]: Done uploading segments...
Mar 18 21:54:39.677859307 (197h43m42.693528908s) [upload=189883]: Upload finished. err: <nil>
Duration: 2.303103154s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
3.259534036s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:55:39 UTC)
orbiter warning: context deadline exceeded
Duration: 3.259562261s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [....................................X....X.XXXX.XXX...XXXX..]
duration:
2.275324889s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:55:38 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 2.275356424s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [.................................XX.....XXX..X..XXX.XXXX.XX.]
duration:
2.560237533s
trace:
https://jaeger.dev.storj.io/trace/75e0f0868fd0d72
FAIL (2026-03-18 21:55:24 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:54:18.149554843 (197h43m21.165224435s) [upload=189883]: Starting upload
Mar 18 21:54:18.149629705 (197h43m21.165299296s) [upload=189883]: Done starting upload
Mar 18 21:54:18.149726090 (197h43m21.16539568s) [upload=189883]: Uploading segments...
Mar 18 21:54:18.149968905 (197h43m21.165638498s) [upload=189883]: Got next segment. Inline: false
Mar 18 21:54:18.150024167 (197h43m21.165693769s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:54:18.150031397 (197h43m21.165700997s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:26.308528312 (197h43m29.324197912s) [seg_pos={0 0}, upload=189883]: Begin upload segment...
Mar 18 21:54:26.308650989 (197h43m29.324320588s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.309947151 (197h43m29.325616759s) [seg_pos={0 0}, upload=189883]: Done begin upload segment.
Mar 18 21:54:26.310024877 (197h43m29.325694487s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.310648388 (197h43m29.326318s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.311260449 (197h43m29.32693006s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.312476969 (197h43m29.328146592s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.313742039 (197h43m29.329411642s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.314129731 (197h43m29.32979934s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.315306083 (197h43m29.330975691s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.316537735 (197h43m29.332207343s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.317296012 (197h43m29.332965624s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.318422029 (197h43m29.334091636s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.319037770 (197h43m29.334707382s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.320223299 (197h43m29.335892922s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321492900 (197h43m29.337162507s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321765536 (197h43m29.337435143s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.323594932 (197h43m29.339264544s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.935519647 (197h43m29.951189247s) [upload=189883]: Next returned nil segment
Mar 18 21:54:26.935535154 (197h43m29.951204754s) [upload=189883]: Waiting for error group managing segments...
Mar 18 21:54:27.064763826 (197h43m30.080433427s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066336450 (197h43m30.08200605s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066710529 (197h43m30.082380129s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067163041 (197h43m30.082832641s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067539264 (197h43m30.083208864s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067890346 (197h43m30.08355995s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.068825983 (197h43m30.084495583s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071631864 (197h43m30.087301453s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071767013 (197h43m30.087436614s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.072116600 (197h43m30.0877862s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.073662705 (197h43m30.089332313s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.081111494 (197h43m30.096781094s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085500985 (197h43m30.101170602s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085522039 (197h43m30.10119164s) [seg_pos={0 0}, upload=189883]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:27.086116447 (197h43m30.101786058s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086202338 (197h43m30.101871943s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086610013 (197h43m30.102279622s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086645950 (197h43m30.10231555s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086923172 (197h43m30.102592787s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hV2HLvT4YUVqeM2eAVe8p8UFVsZK7MYN95YinC8KMss9sKDXt): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086949914 (197h43m30.102619517s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.087062900 (197h43m30.10273249s) [seg_pos={0 0}, upload=189883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:54:27.087234507 (197h43m30.102904107s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:27.087240800 (197h43m30.1029104s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:39.677837110 (197h43m42.693506704s) [upload=189883]: Done uploading segments...
Mar 18 21:54:39.677859307 (197h43m42.693528908s) [upload=189883]: Upload finished. err: <nil>
Duration: 2.560275168s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [........................................XXX..XX.XX..XX......]
duration:
5.851903464s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:55:23 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 5.851919415s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [...................................XX....XXXXXX..XX.XXXXXXX.]
duration:
1.454424004s
trace:
https://jaeger.dev.storj.io/trace/1e14c800e54addc9
FAIL (2026-03-18 21:55:21 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 1.454455032s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [.....................................X....X.XXXX.XXX...XXXX.]
duration:
18.651373084s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:55:20 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 18.65140052s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.001013192s
trace:
https://jaeger.dev.storj.io/trace/2c02709149f42d48
FAIL (2026-03-18 21:55:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00103507s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
29.812856727s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:55:19 UTC)
orbiter warning: context deadline exceeded
Duration: 29.812884585s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [.........................................XXX..XX.XX..XX.....]
duration:
29.325504362s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:55:17 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 29.325612007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [....................................XX....XXXXXX..XX.XXXXXXX]
duration:
30.065157045s
trace:
https://jaeger.dev.storj.io/trace/1e14c800e54addc9
FAIL (2026-03-18 21:55:06 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 30.065254424s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000941071s
trace:
https://jaeger.dev.storj.io/trace/3fdf45c99d63ba3e
FAIL (2026-03-18 21:55:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000967595s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [..................................XX.....XXX..X..XXX.XXXX.XX]
duration:
30.001986069s
trace:
https://jaeger.dev.storj.io/trace/75e0f0868fd0d72
FAIL (2026-03-18 21:54:47 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:54:18.149554843 (197h43m21.165224435s) [upload=189883]: Starting upload
Mar 18 21:54:18.149629705 (197h43m21.165299296s) [upload=189883]: Done starting upload
Mar 18 21:54:18.149726090 (197h43m21.16539568s) [upload=189883]: Uploading segments...
Mar 18 21:54:18.149968905 (197h43m21.165638498s) [upload=189883]: Got next segment. Inline: false
Mar 18 21:54:18.150024167 (197h43m21.165693769s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:54:18.150031397 (197h43m21.165700997s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:26.308528312 (197h43m29.324197912s) [seg_pos={0 0}, upload=189883]: Begin upload segment...
Mar 18 21:54:26.308650989 (197h43m29.324320588s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.309947151 (197h43m29.325616759s) [seg_pos={0 0}, upload=189883]: Done begin upload segment.
Mar 18 21:54:26.310024877 (197h43m29.325694487s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.310648388 (197h43m29.326318s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.311260449 (197h43m29.32693006s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.312476969 (197h43m29.328146592s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.313742039 (197h43m29.329411642s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.314129731 (197h43m29.32979934s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.315306083 (197h43m29.330975691s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.316537735 (197h43m29.332207343s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.317296012 (197h43m29.332965624s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.318422029 (197h43m29.334091636s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.319037770 (197h43m29.334707382s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.320223299 (197h43m29.335892922s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321492900 (197h43m29.337162507s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.321765536 (197h43m29.337435143s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.323594932 (197h43m29.339264544s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Uploading piece...
Mar 18 21:54:26.935519647 (197h43m29.951189247s) [upload=189883]: Next returned nil segment
Mar 18 21:54:26.935535154 (197h43m29.951204754s) [upload=189883]: Waiting for error group managing segments...
Mar 18 21:54:27.064763826 (197h43m30.080433427s) [noise=true , address=77.90.31.19:4842     , piece_id=PWAEYFLRCTKDT4H7AG7LAUJKUWWU45SOQTPC4PHUIFUSFDRLBR7A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066336450 (197h43m30.08200605s) [noise=true , address=45.91.116.8:4080     , piece_id=CN3YXD7WEAUY57YFADWOVHPPANYZJBRT4VPJ6INVCISIFKB7CKCQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.066710529 (197h43m30.082380129s) [noise=true , address=77.90.31.10:4518     , piece_id=HRYWJZEFJJ5NV6DFG7XM6VY2AFWNF5D6CFTPESBTI42J5WAW7MXA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067163041 (197h43m30.082832641s) [noise=true , address=145.79.227.14:4841   , piece_id=GZXEN7OM7IAP5PSXSVR5SVSDKHD33ISGVVIGWQQPFS4HGLJMUROQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067539264 (197h43m30.083208864s) [noise=true , address=45.91.116.14:4193    , piece_id=KWARE3PWKRLL3DCJ6FX47725P57CGFFS4DR6UOTHDJZQQOKJSKHQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.067890346 (197h43m30.08355995s) [noise=true , address=45.91.116.11:4118    , piece_id=YSU73JQIBOQBE5YQ7LQKSQM6FURD5OLQRPPTS55WEEEVW4KMGLPQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.068825983 (197h43m30.084495583s) [noise=true , address=145.79.227.32:4833   , piece_id=I4MJO76NNIEOOP44VSTOOY2MDNSWR2JLDSGJWQ4TSF45SYEAF3KA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071631864 (197h43m30.087301453s) [noise=true , address=145.79.227.46:4606   , piece_id=IDZPEIF73YXZPU2U35NW2JBCIZXJ42APUZDZLBBH2QN6HP4YNRRA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.071767013 (197h43m30.087436614s) [noise=true , address=45.91.116.7:4009     , piece_id=DWR7XXGJVAAISBACLPLWVTKZXU3EJY6SXD7CNAW7XSL6O76AMLJA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.072116600 (197h43m30.0877862s) [noise=true , address=145.79.227.44:4195   , piece_id=K3YARWO7WM6N3QEC4ZJWJIGP6AWRSWGZQSBYH6UU3NP6M6QFHX3Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.073662705 (197h43m30.089332313s) [noise=true , address=77.90.31.13:4626     , piece_id=CLILSPUBHXP3VEGE6OQNFO7QZI564POQHZNN3267TIJVODMG4N2Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.081111494 (197h43m30.096781094s) [noise=true , address=45.91.116.4:4955     , piece_id=ZM2JV5BN5U3LKLPEQOOH4D42QHVZJFYPZCHFXU2SHXFSOJFXJVTA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085500985 (197h43m30.101170602s) [noise=true , address=145.79.227.45:4230   , piece_id=O2X5ADE7BIIR3HHLF2PETI6ZWYPQSU4SNV3BVBCVNT5CZ722SEDQ, seg_pos={0 0}, upload=189883]: Done uploading piece. err: <nil>
Mar 18 21:54:27.085522039 (197h43m30.10119164s) [seg_pos={0 0}, upload=189883]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:27.086116447 (197h43m30.101786058s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086202338 (197h43m30.101871943s) [noise=true , address=145.79.227.22:4515   , piece_id=GYGZ7KRMHQDTPI6XZRGMPOEYXRGXMY2FURVUUYUB7AA6CFEH326Q, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086610013 (197h43m30.102279622s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086645950 (197h43m30.10231555s) [noise=true , address=77.90.31.16:4738     , piece_id=E7IKMPRSNQXCACUY5HBRDPN4YZ37APUXQQZVHED4YQJGC7YPHZ4A, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.086923172 (197h43m30.102592787s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hV2HLvT4YUVqeM2eAVe8p8UFVsZK7MYN95YinC8KMss9sKDXt): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:27.086949914 (197h43m30.102619517s) [noise=true , address=145.79.227.43:4162   , piece_id=HIMVFURGSWUMODFHILTPC7DM3CLYZ4NSTOWLFIKN7B257EYLZTIA, seg_pos={0 0}, upload=189883]: Long tail cancellation due to optimal threshold
Mar 18 21:54:27.087062900 (197h43m30.10273249s) [seg_pos={0 0}, upload=189883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:54:27.087234507 (197h43m30.102904107s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:27.087240800 (197h43m30.1029104s) [upload=189883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:39.677837110 (197h43m42.693506704s) [upload=189883]: Done uploading segments...
Mar 18 21:54:39.677859307 (197h43m42.693528908s) [upload=189883]: Upload finished. err: <nil>
Duration: 30.002009425s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [......................................X....X.XXXX.XXX...XXXX]
duration:
30.10675018s
trace:
https://jaeger.dev.storj.io/trace/61dc9d7af1d4ec01
FAIL (2026-03-18 21:54:39 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.106766264s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [..........................................XXX..XX.XX..XX....]
duration:
29.858612914s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:54:35 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 29.858631093s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000845379s
trace:
https://jaeger.dev.storj.io/trace/741c9197d0b02051
FAIL (2026-03-18 21:54:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000872315s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
23.710268185s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:54:32 UTC)
orbiter warning: context deadline exceeded
Duration: 23.710312439s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
14 out of 60 is failed (threshold=3) [...................................XX.....XXX..X..XXX.XXXX.X]
duration:
30.109622155s
trace:
https://jaeger.dev.storj.io/trace/6b060a148f624928
FAIL (2026-03-18 21:54:14 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:53:44.417251432 (197h42m47.432921032s) [upload=189875]: Starting upload
Mar 18 21:53:44.417327240 (197h42m47.432996828s) [upload=189875]: Done starting upload
Mar 18 21:53:44.417706839 (197h42m47.43337643s) [upload=189875]: Uploading segments...
Mar 18 21:53:44.417767098 (197h42m47.433436688s) [upload=189875]: Got next segment. Inline: false
Mar 18 21:53:44.417815252 (197h42m47.433484853s) [upload=189875]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:53:44.417822498 (197h42m47.433492105s) [upload=189875]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:54:00.701706824 (197h43m3.717376429s) [seg_pos={0 0}, upload=189875]: Begin upload segment...
Mar 18 21:54:00.701789344 (197h43m3.717458947s) [seg_pos={0 0}, upload=189875]: Done begin upload segment.
Mar 18 21:54:00.701845477 (197h43m3.717515083s) [noise=true , address=145.79.227.39:4018   , piece_id=7RHV7Y6E2BK7MJ45ZBXREIOUFRQMSKNQ723J5DKFN234XACAPWCQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.701857206 (197h43m3.717526814s) [noise=true , address=45.91.116.12:4255    , piece_id=ZA5NM7GX42T6JIN3PD67UZYLZWGDC2ZD6K377VMMVA4D3ZDKJUTQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.703016136 (197h43m3.718685748s) [noise=true , address=145.79.227.45:4233   , piece_id=ADJ72BITEFA6CAH52TUOG7VSUD5SBSUFSMKSOEIGAAPZB6MB4FJA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.703607148 (197h43m3.719276758s) [noise=true , address=45.91.116.9:4264     , piece_id=JOM4HCVW7NSPROODCN7EBXHTV43BKXEYJHL5RI2XL67J6MSWM7GQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.703910525 (197h43m3.719580135s) [noise=true , address=145.79.227.12:4769   , piece_id=OC5K52K65UJ4VNHAQ7CWLF2CXUO6LEMEJ2XXBXLZNRJODRXGTAWA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.705260347 (197h43m3.720929977s) [noise=true , address=145.79.227.19:4083   , piece_id=R6XQHA5XRRPL5XABL3YRHBLRBUIHNQLUS7BWPIPCL7GHE3X5ISAQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.705903647 (197h43m3.721573259s) [noise=true , address=77.90.31.12:4589     , piece_id=RRYTLPZO4WM4SXNOXJZOEVVG7N27BRWLMNSG5BWXBE4HVI3UR3DA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.706826114 (197h43m3.722495719s) [noise=true , address=145.79.227.22:4513   , piece_id=5OVAAEI4YDMMFNKQS23D5TPM5YHDVMFQZBA6WMNRX2VPLXU6L35A, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.707669332 (197h43m3.72333894s) [noise=true , address=145.79.227.51:4415   , piece_id=AHEJAMKWTEUP7HZ4QWXYAHSRHDZEGJ6I5DQB3ESVQ576KXUY4TGA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.708392460 (197h43m3.724062063s) [noise=true , address=145.79.227.47:4271   , piece_id=K6FYRWWJDKZILNAUPVS6LMHIORCFSM7MULOTG34MQOI26C6NIOJQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.709151550 (197h43m3.72482116s) [noise=true , address=145.79.227.48:4307   , piece_id=4MWCHPELIVALKPXIOFZ4KK4BZYKJNFZAKJQPC2XN6VOHAX4QZV6Q, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.710594715 (197h43m3.726264322s) [noise=true , address=145.79.227.42:4123   , piece_id=SWQAJ2JRC2A3AFZUO3I5D3GRISFIZ3MZOS7HF6DOUQLJJ45BPUTQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.711195490 (197h43m3.726865097s) [noise=true , address=145.79.227.15:4879   , piece_id=YU4XJMMY6PYMBASQ62NX7AP5I3JQUTHWBFXAAE7PHK7NAH65JWBA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.712143299 (197h43m3.727812913s) [noise=true , address=145.79.227.3:4154    , piece_id=G6CGY2SNV5NPKM5B3MS5IV65KPKUNC5IGOAPX7Z4C4RDAUINENDQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.714272680 (197h43m3.729942291s) [noise=true , address=145.79.227.44:4194   , piece_id=CNK4PSA6J4C6LZJI66G6VY6XZFMAI7BNN7ESTL3FL2XRL5X3LQDA, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:00.716225475 (197h43m3.731895072s) [noise=true , address=145.79.227.43:4163   , piece_id=67WJ5W5EKKLWSPOYFWKCYCQEWUCWN747QS2WULL23ODO3MIVOVYQ, seg_pos={0 0}, upload=189875]: Uploading piece...
Mar 18 21:54:01.331770078 (197h43m4.34743968s) [upload=189875]: Next returned nil segment
Mar 18 21:54:01.331789681 (197h43m4.347459289s) [upload=189875]: Waiting for error group managing segments...
Mar 18 21:54:01.467899318 (197h43m4.483568919s) [noise=true , address=145.79.227.15:4879   , piece_id=YU4XJMMY6PYMBASQ62NX7AP5I3JQUTHWBFXAAE7PHK7NAH65JWBA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.470004499 (197h43m4.485674103s) [noise=true , address=145.79.227.47:4271   , piece_id=K6FYRWWJDKZILNAUPVS6LMHIORCFSM7MULOTG34MQOI26C6NIOJQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.470058824 (197h43m4.485728425s) [noise=true , address=145.79.227.39:4018   , piece_id=7RHV7Y6E2BK7MJ45ZBXREIOUFRQMSKNQ723J5DKFN234XACAPWCQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.470917915 (197h43m4.486587515s) [noise=true , address=145.79.227.19:4083   , piece_id=R6XQHA5XRRPL5XABL3YRHBLRBUIHNQLUS7BWPIPCL7GHE3X5ISAQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.471054261 (197h43m4.486723852s) [noise=true , address=45.91.116.12:4255    , piece_id=ZA5NM7GX42T6JIN3PD67UZYLZWGDC2ZD6K377VMMVA4D3ZDKJUTQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.472757967 (197h43m4.488427571s) [noise=true , address=77.90.31.12:4589     , piece_id=RRYTLPZO4WM4SXNOXJZOEVVG7N27BRWLMNSG5BWXBE4HVI3UR3DA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.476043498 (197h43m4.491713103s) [noise=true , address=145.79.227.45:4233   , piece_id=ADJ72BITEFA6CAH52TUOG7VSUD5SBSUFSMKSOEIGAAPZB6MB4FJA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.477009596 (197h43m4.492679198s) [noise=true , address=145.79.227.48:4307   , piece_id=4MWCHPELIVALKPXIOFZ4KK4BZYKJNFZAKJQPC2XN6VOHAX4QZV6Q, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.478496853 (197h43m4.494166461s) [noise=true , address=145.79.227.12:4769   , piece_id=OC5K52K65UJ4VNHAQ7CWLF2CXUO6LEMEJ2XXBXLZNRJODRXGTAWA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.478796347 (197h43m4.494465949s) [noise=true , address=145.79.227.22:4513   , piece_id=5OVAAEI4YDMMFNKQS23D5TPM5YHDVMFQZBA6WMNRX2VPLXU6L35A, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.480765095 (197h43m4.496434702s) [noise=true , address=145.79.227.3:4154    , piece_id=G6CGY2SNV5NPKM5B3MS5IV65KPKUNC5IGOAPX7Z4C4RDAUINENDQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.481706282 (197h43m4.497375887s) [noise=true , address=145.79.227.42:4123   , piece_id=SWQAJ2JRC2A3AFZUO3I5D3GRISFIZ3MZOS7HF6DOUQLJJ45BPUTQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.491853278 (197h43m4.507522884s) [noise=true , address=45.91.116.9:4264     , piece_id=JOM4HCVW7NSPROODCN7EBXHTV43BKXEYJHL5RI2XL67J6MSWM7GQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.491890516 (197h43m4.507560242s) [seg_pos={0 0}, upload=189875]: Satisfied cohort requirements after 13 pieces
Mar 18 21:54:01.491935934 (197h43m4.507605559s) [noise=true , address=145.79.227.51:4415   , piece_id=AHEJAMKWTEUP7HZ4QWXYAHSRHDZEGJ6I5DQB3ESVQ576KXUY4TGA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: <nil>
Mar 18 21:54:01.491958390 (197h43m4.507627997s) [seg_pos={0 0}, upload=189875]: Satisfied cohort requirements after 14 pieces
Mar 18 21:54:01.492152480 (197h43m4.507822101s) [noise=true , address=145.79.227.43:4163   , piece_id=67WJ5W5EKKLWSPOYFWKCYCQEWUCWN747QS2WULL23ODO3MIVOVYQ, seg_pos={0 0}, upload=189875]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:01.492164745 (197h43m4.507834359s) [noise=true , address=145.79.227.43:4163   , piece_id=67WJ5W5EKKLWSPOYFWKCYCQEWUCWN747QS2WULL23ODO3MIVOVYQ, seg_pos={0 0}, upload=189875]: Long tail cancellation due to optimal threshold
Mar 18 21:54:01.492361327 (197h43m4.508030938s) [noise=true , address=145.79.227.44:4194   , piece_id=CNK4PSA6J4C6LZJI66G6VY6XZFMAI7BNN7ESTL3FL2XRL5X3LQDA, seg_pos={0 0}, upload=189875]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF
Mar 18 21:54:01.492374829 (197h43m4.508044443s) [noise=true , address=145.79.227.44:4194   , piece_id=CNK4PSA6J4C6LZJI66G6VY6XZFMAI7BNN7ESTL3FL2XRL5X3LQDA, seg_pos={0 0}, upload=189875]: Long tail cancellation due to optimal threshold
Mar 18 21:54:01.492407909 (197h43m4.508077512s) [seg_pos={0 0}, upload=189875]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Mar 18 21:54:01.492518203 (197h43m4.508187815s) [upload=189875]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:54:01.492525454 (197h43m4.508195059s) [upload=189875]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:54:14.111385180 (197h43m17.127054781s) [upload=189875]: Done uploading segments...
Mar 18 21:54:14.111517368 (197h43m17.127186977s) [upload=189875]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.109641686s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
12 out of 60 is failed (threshold=3) [.......................................X....X.XXXX.XXX...XXX]
duration:
30.006623568s
trace:
https://jaeger.dev.storj.io/trace/679dde488f3aaf44
FAIL (2026-03-18 21:54:09 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 30.006657646s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
16 out of 60 is failed (threshold=3) [.....................................XX....XXXXXX..XX.XXXXXX]
duration:
30.001711635s
trace:
https://jaeger.dev.storj.io/trace/6c096200a3b0c522
FAIL (2026-03-18 21:54:06 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 30.00183446s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [...........................................XXX..XX.XX..XX...]
duration:
26.586765343s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:54:05 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 26.586793223s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXX]
duration:
5.001102832s
trace:
https://jaeger.dev.storj.io/trace/138d7ca425ec6505
FAIL (2026-03-18 21:53:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001129221s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
32.118584479s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:53:49 UTC)
orbiter warning: context deadline exceeded
Duration: 32.118845389s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [....................................XX.....XXX..X..XXX.XXXX.]
duration:
23.215804529s
trace:
https://jaeger.dev.storj.io/trace/4d152ac75ebca5bb
FAIL (2026-03-18 21:53:40 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:52:39.916474565 (197h41m42.932144166s) [upload=189858]: Starting upload
Mar 18 21:52:39.916533531 (197h41m42.932203122s) [upload=189858]: Done starting upload
Mar 18 21:52:39.916575478 (197h41m42.932245078s) [upload=189858]: Uploading segments...
Mar 18 21:52:39.916812138 (197h41m42.932481754s) [upload=189858]: Got next segment. Inline: false
Mar 18 21:52:39.916873368 (197h41m42.932542969s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:52:39.916878991 (197h41m42.932548591s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:52:56.142140804 (197h41m59.157810404s) [seg_pos={0 0}, upload=189858]: Begin upload segment...
Mar 18 21:52:56.142191364 (197h41m59.157860951s) [seg_pos={0 0}, upload=189858]: Done begin upload segment.
Mar 18 21:52:56.142222197 (197h41m59.157891802s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.142335676 (197h41m59.158005275s) [noise=true , address=145.79.227.12:4768   , piece_id=4HYO3HLX3QQGCAX4FG7DXTFU4IT74BJ5VJRKH2SUDULBKR732DBQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.142914442 (197h41m59.158584045s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143159844 (197h41m59.158829443s) [noise=true , address=145.79.227.22:4514   , piece_id=ZFURV73Q5V6CPXNEAS7D6FQWVJ4RCHZ7PDB2GLRLBU3WBANBHT3A, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143389729 (197h41m59.159059332s) [noise=true , address=145.79.227.20:4439   , piece_id=WF2MQIC3LE4JZPQDJTZ54WKJXJH7LUVKAWIRS3SUT3UVABWAHUIQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143577689 (197h41m59.159247292s) [noise=true , address=145.79.227.27:4692   , piece_id=5ACH66GBJKUP6KNSBXWYAN27OKRNBAEFESH27J4UEO3GIAHJZN3A, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143940126 (197h41m59.159609726s) [noise=true , address=45.91.116.9:4262     , piece_id=FQQ2R2KVTFTPYYVHBBPO6Z6KCNGVIAIN2EAWR4JOZZCMKNRBRATA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144016076 (197h41m59.159685679s) [noise=true , address=145.79.227.40:4053   , piece_id=U42I6CPYH77KEGLD5H7VSH4DCWYBP7QRO4X6JRLTTWLWCFUTHRIA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144411678 (197h41m59.160081285s) [noise=true , address=145.79.227.2:4117    , piece_id=GGTXNX6SMMFG3OB3TOLRNSJX6SDBZK7NLZMDI6SXWKDQLY3IC5BQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144420025 (197h41m59.160089626s) [noise=true , address=145.79.227.48:4304   , piece_id=EGKP5W2H7ON735V54TBF2EQX3BT6WAYV4EGL4MBBI5H3ADX4AGVQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144868909 (197h41m59.160538518s) [noise=true , address=45.91.116.6:4975     , piece_id=NP6X5A6VSLFFVFKOZWBBIV5C5CQBZEBF45U6SX3JS2J4MBMDIRYQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144963829 (197h41m59.160633428s) [noise=true , address=145.79.227.33:4873   , piece_id=SWSNMLFRYCSPILSIXXTNG7JGDBUV37I7QU6N3OIKCGT3ROK7JELQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145416521 (197h41m59.161086128s) [noise=true , address=77.90.31.18:4808     , piece_id=UEHBSARBBSGR5OHT4YQUQWHBW4PDQNVUCETT74HE5MHPXGNQPANA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145634286 (197h41m59.161303889s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145877335 (197h41m59.16154695s) [noise=true , address=145.79.227.49:4337   , piece_id=WLYNVFFP7WO4PXFPLT4TWW3HFXGJRVEK3TT7G4UVCNMKKUK3NDUQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145960742 (197h41m59.161630345s) [noise=true , address=77.90.31.14:4666     , piece_id=VUOZRRNFG6IGZ7XVXTJ6FN3MR7SCGD5TRMAZOETRR3WJXIBU66VQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.747599461 (197h41m59.763269048s) [upload=189858]: Next returned nil segment
Mar 18 21:52:56.747611599 (197h41m59.763281202s) [upload=189858]: Waiting for error group managing segments...
Mar 18 21:52:56.882252585 (197h41m59.897922188s) [noise=true , address=77.90.31.18:4808     , piece_id=UEHBSARBBSGR5OHT4YQUQWHBW4PDQNVUCETT74HE5MHPXGNQPANA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.882659851 (197h41m59.898329467s) [noise=true , address=145.79.227.22:4514   , piece_id=ZFURV73Q5V6CPXNEAS7D6FQWVJ4RCHZ7PDB2GLRLBU3WBANBHT3A, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.884305524 (197h41m59.899975124s) [noise=true , address=77.90.31.14:4666     , piece_id=VUOZRRNFG6IGZ7XVXTJ6FN3MR7SCGD5TRMAZOETRR3WJXIBU66VQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.886382817 (197h41m59.902052418s) [noise=true , address=145.79.227.48:4304   , piece_id=EGKP5W2H7ON735V54TBF2EQX3BT6WAYV4EGL4MBBI5H3ADX4AGVQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.888397035 (197h41m59.904066635s) [noise=true , address=145.79.227.12:4768   , piece_id=4HYO3HLX3QQGCAX4FG7DXTFU4IT74BJ5VJRKH2SUDULBKR732DBQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.888962486 (197h41m59.904632086s) [noise=true , address=45.91.116.9:4262     , piece_id=FQQ2R2KVTFTPYYVHBBPO6Z6KCNGVIAIN2EAWR4JOZZCMKNRBRATA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.889512019 (197h41m59.905181619s) [noise=true , address=145.79.227.49:4337   , piece_id=WLYNVFFP7WO4PXFPLT4TWW3HFXGJRVEK3TT7G4UVCNMKKUK3NDUQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.890028694 (197h41m59.905698299s) [noise=true , address=145.79.227.2:4117    , piece_id=GGTXNX6SMMFG3OB3TOLRNSJX6SDBZK7NLZMDI6SXWKDQLY3IC5BQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.891049066 (197h41m59.906718668s) [noise=true , address=145.79.227.20:4439   , piece_id=WF2MQIC3LE4JZPQDJTZ54WKJXJH7LUVKAWIRS3SUT3UVABWAHUIQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.903232444 (197h41m59.918902049s) [noise=true , address=145.79.227.27:4692   , piece_id=5ACH66GBJKUP6KNSBXWYAN27OKRNBAEFESH27J4UEO3GIAHJZN3A, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.904749473 (197h41m59.920419074s) [noise=true , address=145.79.227.33:4873   , piece_id=SWSNMLFRYCSPILSIXXTNG7JGDBUV37I7QU6N3OIKCGT3ROK7JELQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.906502919 (197h41m59.922172524s) [noise=true , address=145.79.227.40:4053   , piece_id=U42I6CPYH77KEGLD5H7VSH4DCWYBP7QRO4X6JRLTTWLWCFUTHRIA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.908578018 (197h41m59.924247632s) [noise=true , address=45.91.116.6:4975     , piece_id=NP6X5A6VSLFFVFKOZWBBIV5C5CQBZEBF45U6SX3JS2J4MBMDIRYQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.908610966 (197h41m59.924280594s) [seg_pos={0 0}, upload=189858]: Satisfied cohort requirements after 13 pieces
Mar 18 21:52:56.908897578 (197h41m59.924567213s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.908907834 (197h41m59.924577444s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.908912624 (197h41m59.924582231s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121kT5cTDuopYFWfFYdmdj6QBRJMybyL7G2ow4mFeZFEH3QVxE6): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.908927358 (197h41m59.924596971s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.909120063 (197h41m59.924789683s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.909130770 (197h41m59.924800382s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.909159424 (197h41m59.924829025s) [seg_pos={0 0}, upload=189858]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:52:56.909253014 (197h41m59.924922616s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:52:56.909259901 (197h41m59.924929508s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:53:05.664392739 (197h42m8.680062349s) [upload=189858]: Done uploading segments...
Mar 18 21:53:05.664433157 (197h42m8.680102763s) [upload=189858]: Upload finished. err: <nil>
Duration: 23.215893289s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXX]
duration:
5.000768448s
trace:
https://jaeger.dev.storj.io/trace/7f9ffa7f38ea086b
FAIL (2026-03-18 21:53:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000790984s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [............................................XXX..XX.XX..XX..]
duration:
25.802063411s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:53:18 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 25.802098538s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [.....................................XX.....XXX..X..XXX.XXXX]
duration:
30.00229822s
trace:
https://jaeger.dev.storj.io/trace/4d152ac75ebca5bb
FAIL (2026-03-18 21:53:09 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:52:39.916474565 (197h41m42.932144166s) [upload=189858]: Starting upload
Mar 18 21:52:39.916533531 (197h41m42.932203122s) [upload=189858]: Done starting upload
Mar 18 21:52:39.916575478 (197h41m42.932245078s) [upload=189858]: Uploading segments...
Mar 18 21:52:39.916812138 (197h41m42.932481754s) [upload=189858]: Got next segment. Inline: false
Mar 18 21:52:39.916873368 (197h41m42.932542969s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:52:39.916878991 (197h41m42.932548591s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 21:52:56.142140804 (197h41m59.157810404s) [seg_pos={0 0}, upload=189858]: Begin upload segment...
Mar 18 21:52:56.142191364 (197h41m59.157860951s) [seg_pos={0 0}, upload=189858]: Done begin upload segment.
Mar 18 21:52:56.142222197 (197h41m59.157891802s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.142335676 (197h41m59.158005275s) [noise=true , address=145.79.227.12:4768   , piece_id=4HYO3HLX3QQGCAX4FG7DXTFU4IT74BJ5VJRKH2SUDULBKR732DBQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.142914442 (197h41m59.158584045s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143159844 (197h41m59.158829443s) [noise=true , address=145.79.227.22:4514   , piece_id=ZFURV73Q5V6CPXNEAS7D6FQWVJ4RCHZ7PDB2GLRLBU3WBANBHT3A, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143389729 (197h41m59.159059332s) [noise=true , address=145.79.227.20:4439   , piece_id=WF2MQIC3LE4JZPQDJTZ54WKJXJH7LUVKAWIRS3SUT3UVABWAHUIQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143577689 (197h41m59.159247292s) [noise=true , address=145.79.227.27:4692   , piece_id=5ACH66GBJKUP6KNSBXWYAN27OKRNBAEFESH27J4UEO3GIAHJZN3A, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.143940126 (197h41m59.159609726s) [noise=true , address=45.91.116.9:4262     , piece_id=FQQ2R2KVTFTPYYVHBBPO6Z6KCNGVIAIN2EAWR4JOZZCMKNRBRATA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144016076 (197h41m59.159685679s) [noise=true , address=145.79.227.40:4053   , piece_id=U42I6CPYH77KEGLD5H7VSH4DCWYBP7QRO4X6JRLTTWLWCFUTHRIA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144411678 (197h41m59.160081285s) [noise=true , address=145.79.227.2:4117    , piece_id=GGTXNX6SMMFG3OB3TOLRNSJX6SDBZK7NLZMDI6SXWKDQLY3IC5BQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144420025 (197h41m59.160089626s) [noise=true , address=145.79.227.48:4304   , piece_id=EGKP5W2H7ON735V54TBF2EQX3BT6WAYV4EGL4MBBI5H3ADX4AGVQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144868909 (197h41m59.160538518s) [noise=true , address=45.91.116.6:4975     , piece_id=NP6X5A6VSLFFVFKOZWBBIV5C5CQBZEBF45U6SX3JS2J4MBMDIRYQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.144963829 (197h41m59.160633428s) [noise=true , address=145.79.227.33:4873   , piece_id=SWSNMLFRYCSPILSIXXTNG7JGDBUV37I7QU6N3OIKCGT3ROK7JELQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145416521 (197h41m59.161086128s) [noise=true , address=77.90.31.18:4808     , piece_id=UEHBSARBBSGR5OHT4YQUQWHBW4PDQNVUCETT74HE5MHPXGNQPANA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145634286 (197h41m59.161303889s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145877335 (197h41m59.16154695s) [noise=true , address=145.79.227.49:4337   , piece_id=WLYNVFFP7WO4PXFPLT4TWW3HFXGJRVEK3TT7G4UVCNMKKUK3NDUQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.145960742 (197h41m59.161630345s) [noise=true , address=77.90.31.14:4666     , piece_id=VUOZRRNFG6IGZ7XVXTJ6FN3MR7SCGD5TRMAZOETRR3WJXIBU66VQ, seg_pos={0 0}, upload=189858]: Uploading piece...
Mar 18 21:52:56.747599461 (197h41m59.763269048s) [upload=189858]: Next returned nil segment
Mar 18 21:52:56.747611599 (197h41m59.763281202s) [upload=189858]: Waiting for error group managing segments...
Mar 18 21:52:56.882252585 (197h41m59.897922188s) [noise=true , address=77.90.31.18:4808     , piece_id=UEHBSARBBSGR5OHT4YQUQWHBW4PDQNVUCETT74HE5MHPXGNQPANA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.882659851 (197h41m59.898329467s) [noise=true , address=145.79.227.22:4514   , piece_id=ZFURV73Q5V6CPXNEAS7D6FQWVJ4RCHZ7PDB2GLRLBU3WBANBHT3A, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.884305524 (197h41m59.899975124s) [noise=true , address=77.90.31.14:4666     , piece_id=VUOZRRNFG6IGZ7XVXTJ6FN3MR7SCGD5TRMAZOETRR3WJXIBU66VQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.886382817 (197h41m59.902052418s) [noise=true , address=145.79.227.48:4304   , piece_id=EGKP5W2H7ON735V54TBF2EQX3BT6WAYV4EGL4MBBI5H3ADX4AGVQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.888397035 (197h41m59.904066635s) [noise=true , address=145.79.227.12:4768   , piece_id=4HYO3HLX3QQGCAX4FG7DXTFU4IT74BJ5VJRKH2SUDULBKR732DBQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.888962486 (197h41m59.904632086s) [noise=true , address=45.91.116.9:4262     , piece_id=FQQ2R2KVTFTPYYVHBBPO6Z6KCNGVIAIN2EAWR4JOZZCMKNRBRATA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.889512019 (197h41m59.905181619s) [noise=true , address=145.79.227.49:4337   , piece_id=WLYNVFFP7WO4PXFPLT4TWW3HFXGJRVEK3TT7G4UVCNMKKUK3NDUQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.890028694 (197h41m59.905698299s) [noise=true , address=145.79.227.2:4117    , piece_id=GGTXNX6SMMFG3OB3TOLRNSJX6SDBZK7NLZMDI6SXWKDQLY3IC5BQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.891049066 (197h41m59.906718668s) [noise=true , address=145.79.227.20:4439   , piece_id=WF2MQIC3LE4JZPQDJTZ54WKJXJH7LUVKAWIRS3SUT3UVABWAHUIQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.903232444 (197h41m59.918902049s) [noise=true , address=145.79.227.27:4692   , piece_id=5ACH66GBJKUP6KNSBXWYAN27OKRNBAEFESH27J4UEO3GIAHJZN3A, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.904749473 (197h41m59.920419074s) [noise=true , address=145.79.227.33:4873   , piece_id=SWSNMLFRYCSPILSIXXTNG7JGDBUV37I7QU6N3OIKCGT3ROK7JELQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.906502919 (197h41m59.922172524s) [noise=true , address=145.79.227.40:4053   , piece_id=U42I6CPYH77KEGLD5H7VSH4DCWYBP7QRO4X6JRLTTWLWCFUTHRIA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.908578018 (197h41m59.924247632s) [noise=true , address=45.91.116.6:4975     , piece_id=NP6X5A6VSLFFVFKOZWBBIV5C5CQBZEBF45U6SX3JS2J4MBMDIRYQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: <nil>
Mar 18 21:52:56.908610966 (197h41m59.924280594s) [seg_pos={0 0}, upload=189858]: Satisfied cohort requirements after 13 pieces
Mar 18 21:52:56.908897578 (197h41m59.924567213s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.908907834 (197h41m59.924577444s) [noise=true , address=77.90.31.10:4519     , piece_id=VWKQE5G65K2WBODPKK6W5QII4YIOG5VATI4TAV3TX3N4P7XOVEBA, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.908912624 (197h41m59.924582231s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121kT5cTDuopYFWfFYdmdj6QBRJMybyL7G2ow4mFeZFEH3QVxE6): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.908927358 (197h41m59.924596971s) [noise=true , address=79.127.219.45:4856   , piece_id=7NNL4JIJMK26NKK6GJZRKBGXBHRBREBXR354E4YXI3QENG43SBUQ, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.909120063 (197h41m59.924789683s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Mar 18 21:52:56.909130770 (197h41m59.924800382s) [noise=true , address=79.127.219.46:4889   , piece_id=N67KGEDXKGHHBLGY3FSCULNAYR4GKKUA2JIQI5BOKMDYJINEY43Q, seg_pos={0 0}, upload=189858]: Long tail cancellation due to optimal threshold
Mar 18 21:52:56.909159424 (197h41m59.924829025s) [seg_pos={0 0}, upload=189858]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Mar 18 21:52:56.909253014 (197h41m59.924922616s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 18 21:52:56.909259901 (197h41m59.924929508s) [upload=189858]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:53:05.664392739 (197h42m8.680062349s) [upload=189858]: Done uploading segments...
Mar 18 21:53:05.664433157 (197h42m8.680102763s) [upload=189858]: Upload finished. err: <nil>
Duration: 30.002324965s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
11 out of 60 is failed (threshold=3) [........................................X....X.XXXX.XXX...XX]
duration:
30.005129566s
trace:
https://jaeger.dev.storj.io/trace/4f59df7c76a6937
FAIL (2026-03-18 21:52:59 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 30.005150579s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
15 out of 60 is failed (threshold=3) [......................................XX....XXXXXX..XX.XXXXX]
duration:
30.001903027s
trace:
https://jaeger.dev.storj.io/trace/15fd13ecd5239ab4
FAIL (2026-03-18 21:52:56 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 30.001925803s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
31.599747732s
trace:
https://jaeger.dev.storj.io/trace/ebcefeaecc8948f
FAIL (2026-03-18 21:52:46 UTC)
orbiter warning: context deadline exceeded
Duration: 31.599763041s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
53 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXX......XXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX]
duration:
5.001890049s
trace:
https://jaeger.dev.storj.io/trace/2016f35c2abfedd7
FAIL (2026-03-18 21:52:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001916425s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
9 out of 60 is failed (threshold=3) [.............................................XXX..XX.XX..XX.]
duration:
21.990133787s
trace:
https://jaeger.dev.storj.io/trace/65f276fda07fe2e
FAIL (2026-03-18 21:52:28 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Mar 18 21:50:55.785119820 (197h39m58.800789429s) [upload=189833]: Starting upload
Mar 18 21:50:55.785202430 (197h39m58.80087204s) [upload=189833]: Done starting upload
Mar 18 21:50:55.785303739 (197h39m58.800973328s) [upload=189833]: Uploading segments...
Mar 18 21:50:55.785387166 (197h39m58.801056775s) [upload=189833]: Got next segment. Inline: true
Mar 18 21:50:55.785393596 (197h39m58.801063197s) [upload=189833]: Waiting for error group managing segments...
Mar 18 21:50:55.785466465 (197h39m58.801136064s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 21:50:55.785472300 (197h39m58.801141901s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Mar 18 21:50:55.785497156 (197h39m58.801166757s) [upload=189833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 18 21:51:20.588512781 (197h40m23.604182387s) [upload=189833]: Done uploading segments...
Mar 18 21:51:20.588537265 (197h40m23.604206873s) [upload=189833]: Upload finished. err: <nil>
Duration: 21.990186731s core uplink us-select-1