Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
2.723524962s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:41:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.723556289s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..................................................XX........] duration:
2.169146016s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:41:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.169175506s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
2.42980708s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:41:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.429840072s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.626690401s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:41:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 3.62672094s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........] duration:
2.495622308s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:41:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.495665847s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.562024925s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:40:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 3.562059592s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................XX........] duration:
2.49391744s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:40:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.493952341s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...................................................XX.......] duration:
2.342091046s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:40:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.342206552s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................XX.......] duration:
2.325099989s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:40:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.32513963s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....................................................XX......] duration:
1.742075081s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:39:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.742105853s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.429352279s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:39:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 3.42938275s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................XX......] duration:
2.433435867s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:39:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.433548689s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.....................................................XX.....] duration:
1.836890927s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:39:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.836918662s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration:
2.442072785s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:38:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.442103408s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....] duration:
3.637300268s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:38:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 3.637393276s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.137406959s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:38:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 3.137432361s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [......................................................XX....] duration:
4.218859081s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:37:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.218904277s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.154720567s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:37:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 3.154749278s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.......................................................XX...] duration:
1.805655782s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:37:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.8056747s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
2.396652634s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:37:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.396739376s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [........................................................XX..] duration:
1.684052454s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:37:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.684076767s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.165467672s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:36:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 4.165497527s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..] duration:
7.444144909s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:36:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 7.444236208s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
7.529585793s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:36:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 7.529611576s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.........................................................XX.] duration:
1.90588215s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:36:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.905914967s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.109763322s trace:
https://jaeger.dev.storj.io/trace/2b156773aff13a05
FAIL (2026-04-11 00:36:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
os={0 0}, upload=77081]: Done begin upload segment.
Apr 11 00:35:36.607753362 (80h18m47.201864604s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609152089 (80h18m47.203263338s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609360181 (80h18m47.203471424s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.609753819 (80h18m47.203865081s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610072200 (80h18m47.20418344s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610268942 (80h18m47.20438019s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610574800 (80h18m47.204686042s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.610731353 (80h18m47.204842599s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611095332 (80h18m47.205206571s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611192823 (80h18m47.205304062s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611615833 (80h18m47.205727076s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.611772854 (80h18m47.2058841s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612002035 (80h18m47.206113277s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612449991 (80h18m47.206561233s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.612488077 (80h18m47.206599327s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:36.614557840 (80h18m47.208669079s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Uploading piece...
Apr 11 00:35:37.207182182 (80h18m47.801293437s) [upload=77081]: Next returned nil segment
Apr 11 00:35:37.207198012 (80h18m47.801309263s) [upload=77081]: Waiting for error group managing segments...
Apr 11 00:35:37.354583621 (80h18m47.948694872s) [noise=true , address=77.90.31.16:4736 , piece_id=JCA4KDMKEDI2GM6WBNUMUUGO4LP5SXLBVKAPGTZ2LVGZIOJ3O55A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.355618116 (80h18m47.949729356s) [noise=true , address=45.91.116.12:4227 , piece_id=UMM7DUJUTYOQUQOFNKBQGOR3MHHQCGLDDYFY6HSPWUQGXLVZ4AVA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.363570054 (80h18m47.957681298s) [noise=true , address=77.90.31.12:4590 , piece_id=2DXVGZ2FAGZ5IRVJDOE542WIGB5B6PKRDBRUQOHRK573LCVXYVGA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:35:37.380605963 (80h18m47.974717212s) [noise=true , address=77.90.31.11:4557 , piece_id=AEM6JGKYC7S55TSE5UROYACPZ7IVUGA63EYXUI64PA7A6ZZMH4QQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: <nil>
Apr 11 00:36:06.234067450 (80h19m16.828178701s) [noise=true , address=145.79.227.45:4233 , piece_id=EZWKNCV7T66LCBUVSD5UAXJ3KK2JFV5CGWHW6JXNHZX3ZY5IQK2A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: rpc: dial tcp 145.79.227.45:4233: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234463037 (80h19m16.828574286s) [noise=true , address=145.79.227.10:4406 , piece_id=LWXXWS7M7RCJEE6OJVKIWCUGONFWPEPB4LKYMXO76M6FZD54TDLA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234715782 (80h19m16.828827038s) [noise=true , address=145.79.227.12:4769 , piece_id=JBBFBZ57MZMP6WG3V7BFXORXTLSXDOZA4HAQ3CYGQLEIFOPGIAOQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.234764656 (80h19m16.828875916s) [noise=true , address=145.79.227.48:4304 , piece_id=HTIH74T3OG3MJM3CG3X6KLBD3I442ZRAN7YAXPUQZ23YCPWK7ZCA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG, address:145.79.227.48:4304): protocol: rpc: dial tcp 145.79.227.48:4304: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.235062285 (80h19m16.829173536s) [noise=true , address=145.79.227.15:4875 , piece_id=T5YLOUSJBRXXU2UKXUHXLPK2GAJNNV7LACYLPLWXWSKXRRSSXAEA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237352242 (80h19m16.831463499s) [noise=true , address=145.79.227.7:4297 , piece_id=HADWUGMD2TGY3K4AE5GTSK5BV6DICUY6WHQ3M22Z4DKQQ3NJOW5A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86, address:145.79.227.7:4297): protocol: rpc: dial tcp 145.79.227.7:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.237418191 (80h19m16.831529449s) [noise=true , address=145.79.227.4:4188 , piece_id=3BVCINUKA4X5MMDNA32XLSKJT3GJGLQL2LHORI5ANGCZNACWADBQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12pLFHQ2Xj6n53w9eLQtMB4A29k3Xh6w716z5s2CGxwPnBoZcgZ, address:145.79.227.4:4188): protocol: rpc: dial tcp 145.79.227.4:4188: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238026103 (80h19m16.832137353s) [noise=true , address=145.79.227.25:4617 , piece_id=X7CHP4G7TCEWLDJLKP6VB6GOXZPZGHPRHVZWPRIWKP722GJIQE3A, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw, address:145.79.227.25:4617): protocol: rpc: dial tcp 145.79.227.25:4617: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238136590 (80h19m16.832247826s) [noise=true , address=145.79.227.46:4604 , piece_id=QW6HXGFQGRC6F44DC4UQ6V6T7LFY4GCT3N6VIRHLTLK67A3MM5EQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238167799 (80h19m16.832279058s) [noise=true , address=145.79.227.19:4081 , piece_id=PPKC2Z5XYI6LFIIBYJDMOK6KNPNIKUVUV6P65NT55APN73HOEWHQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp, address:145.79.227.19:4081): protocol: rpc: dial tcp 145.79.227.19:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:06.238878716 (80h19m16.832989974s) [noise=true , address=145.79.227.50:4376 , piece_id=KB5XKS4RKDNT4BG2Q2L3XSFJDJUAZNMIHIOYBL4DOB35YVBCTXSA, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:12MnvtjSKHuNKUcVEjTviEGThRKQxzmGiMu1ofCwkv8BLAhGuzL, address:145.79.227.50:4376): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239664077 (80h19m16.833775331s) [noise=true , address=145.79.227.5:4224 , piece_id=EXHZT4P2TVQKG4QZHGNNYDEX2QIMBYAP6CCWOFCFQHY4N3F4JFIQ, seg_pos={0 0}, upload=77081]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:36:06.239722363 (80h19m16.833833613s) [seg_pos={0 0}, upload=77081]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Apr 11 00:36:06.339820291 (80h19m16.93393154s) [upload=77081]: Done uploading segments...
Apr 11 00:36:06.339893921 (80h19m16.934005173s) [upload=77081]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 30.109787432s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
20.579909764s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:36:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 20.579934887s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.114294102s trace:
https://jaeger.dev.storj.io/trace/46130f6078efa43c
FAIL (2026-04-11 00:35:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
ad=77069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 11 00:34:43.794844927 (80h17m54.388956169s) [seg_pos={0 0}, upload=77069]: Begin upload segment...
Apr 11 00:34:43.794911260 (80h17m54.389022502s) [seg_pos={0 0}, upload=77069]: Done begin upload segment.
Apr 11 00:34:43.795033432 (80h17m54.389144662s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.795106843 (80h17m54.389218085s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796325376 (80h17m54.390436621s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.796745253 (80h17m54.390856505s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797331690 (80h17m54.39144294s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.797656318 (80h17m54.391767558s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798142741 (80h17m54.392253986s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798157151 (80h17m54.392268399s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.798678244 (80h17m54.392789496s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799132157 (80h17m54.393243403s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799320325 (80h17m54.393431558s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799544546 (80h17m54.393655788s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.799924439 (80h17m54.394035679s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.802551628 (80h17m54.396662878s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.803497747 (80h17m54.39760899s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.804533930 (80h17m54.39864517s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.805383432 (80h17m54.399494676s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:43.807796955 (80h17m54.401908205s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Uploading piece...
Apr 11 00:34:44.421299600 (80h17m55.015410843s) [upload=77069]: Next returned nil segment
Apr 11 00:34:44.421345070 (80h17m55.015456316s) [upload=77069]: Waiting for error group managing segments...
Apr 11 00:34:44.582519405 (80h17m55.176630646s) [noise=true , address=77.90.31.18:4811 , piece_id=3QX2UC3JZRIGKNDO7DALVXZY34MTVERLQPLAU23BLF6DTBZDLSZA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.597152765 (80h17m55.191264015s) [noise=true , address=77.90.31.14:4671 , piece_id=6IFVKC4LOSJEKP364ER4UQCHPCZLXFH2UOY4F2J66ZEFLKMMDVOA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.864642755 (80h17m55.458753998s) [noise=true , address=167.17.72.70:4768 , piece_id=QC3LRQZYKIUIJ7OYYUNEWW6BJQPPQKI7F2VB5XIMWWRQOAC6GAYQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:44.872186316 (80h17m55.466297574s) [noise=true , address=167.17.72.71:4810 , piece_id=DFLFS45MBIRJAVMM4DAGBRIOG3CW2T5OSKGBJE4X4QNYHOZYPM3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.026075990 (80h17m55.62018723s) [noise=true , address=193.149.164.67:4997 , piece_id=B4SVQK5AMTDEDZC3QXZRRR4EWMBDBOAGFK3FYHVDE4FMML5JVHYA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.028603622 (80h17m55.622714861s) [noise=true , address=193.149.164.69:4080 , piece_id=UJ654YGP7Y7F4EFUJCEZNUGYKL3N5RUZBVSLHQLIPVLHVEMDX2SA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.035500804 (80h17m55.629612044s) [noise=true , address=193.149.164.66:4963 , piece_id=3KMGDMXFE2OVGFWS4I3KJ7RYMFO2S3NFVX2H5T74KIPMMXZDHYXQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.039638177 (80h17m55.633749417s) [noise=true , address=64.49.13.154:4935 , piece_id=O5CJQSGLXQGRESPQL63XLSPDK5SPLXP67YB3SARDLT2KZWO6QL3Q, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.041344727 (80h17m55.63545598s) [noise=true , address=193.149.164.71:4286 , piece_id=M4FEYS2J5XVPKGZAT5PDMYUSXBXXO4QNXRFXCGYCJVQVLJXGWG3A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:45.402114414 (80h17m55.996225664s) [noise=true , address=167.17.72.69:4743 , piece_id=4Y47KFB2G7Z4C6GB3QI4DJ4WEM5ODKSOSBDKBJVER6Y3NUH62X2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:34:46.503621244 (80h17m57.097732493s) [noise=true , address=193.149.164.68:4054 , piece_id=SMDX727ECDRB7AFTW7OHZDUDPFURQ6VPIUOW67XZBFSBTZ7YSF2A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: <nil>
Apr 11 00:35:43.391436872 (80h18m53.985548124s) [noise=true , address=145.79.227.9:4381 , piece_id=C4KYKKMQXYIYYIHTUYK4FJQ2EPEW2NV7PAPF7YRXYF4CF2QMUVIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9, address:145.79.227.9:4381): protocol: rpc: dial tcp 145.79.227.9:4381: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.392202791 (80h18m53.986314041s) [noise=true , address=145.79.227.23:4568 , piece_id=JUFAVT5QZVVXR6LZLSRNZEODSKOOYOCWQC7FUOM5PH7GEAUXDXJA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1Rj4hUGWvUPuU49QDsHYhibiJhyY5KDGus1rzNeP7KusgyvTsU, address:145.79.227.23:4568): protocol: rpc: dial tcp 145.79.227.23:4568: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393141126 (80h18m53.987252383s) [noise=true , address=145.79.227.44:4218 , piece_id=37V2OIPK7VIZQ3GA3BOJHEN63FPJRVXIWSXJWUMKRTBLBJHLAI6A, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:122z4Fys9DYGB3WnjvjiZ5TSA3h8dXvMFcaFfYdpMtxGT6ZiiGH, address:145.79.227.44:4218): protocol: rpc: dial tcp 145.79.227.44:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393196062 (80h18m53.987307312s) [noise=true , address=145.79.227.30:4768 , piece_id=PZAS2FLM4CNR7KUWBPT3BCGSPATUOXIHQNH6Q6I6O64IL52G7KIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: rpc: dial tcp 145.79.227.30:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393473160 (80h18m53.987584419s) [noise=true , address=145.79.227.37:4597 , piece_id=VO234LURTVAKFZPNKAHIX4PCECRF6PKMP2K2EPO2RNYBGHY4KSBQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1q6zcreD1FCjZXuYowJz9amfcQtWySL2iyrFLU8BcPzbD8PhPb, address:145.79.227.37:4597): protocol: rpc: dial tcp 145.79.227.37:4597: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.393616973 (80h18m53.987728225s) [noise=true , address=145.79.227.16:4918 , piece_id=3VNDON4EHAY4RLZBKQ2YOOJ4XXYCSEZFZ3BDIBEIX5ARERGYSMEA, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:12EMGZ4hpXmBp4TwemLrbKAVtjBmtexMzEahRTzFw42qQipsAG, address:145.79.227.16:4918): protocol: rpc: dial tcp 145.79.227.16:4918: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:43.395024614 (80h18m53.989135865s) [noise=true , address=145.79.227.33:4882 , piece_id=MYCNFWZ5IB6V2IKFEQNLFEREMBT5J7VI6OQH6W5TCLVEGGTMKIIQ, seg_pos={0 0}, upload=77069]: Done uploading piece. err: ecclient: upload failed (node:1TU7roqQsKNGvNeqmWdVxMregk9Dqn3YZpfdvK6xp7c3zYvccc, address:145.79.227.33:4882): protocol: context deadline exceeded; context deadline exceeded
Apr 11 00:35:43.395084251 (80h18m53.989195495s) [seg_pos={0 0}, upload=77069]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:35:43.502941515 (80h18m54.097052761s) [upload=77069]: Done uploading segments...
Apr 11 00:35:43.503021418 (80h18m54.097132663s) [upload=77069]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1m0.114324127s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.101520916s trace:
https://jaeger.dev.storj.io/trace/1831c0d95a144424
FAIL (2026-04-11 00:35:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
DERSPNONZ2MAZVS2D2KOBHQWNF3OAORDJJQ, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.371852428 (80h18m10.96596368s) [noise=true , address=145.79.227.52:4449 , piece_id=ZI26P3UU63SLCYJYC7LGJT7HKUO377TJ46KKH24K6ZJDGVVYTT5Q, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.372513334 (80h18m10.966624578s) [noise=true , address=145.79.227.14:4843 , piece_id=7JXX65HEKLZYB7VKJBRRZWM5W4S5FAKK3FL2N4U4PFBI4D6FVS5A, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.373287296 (80h18m10.967398551s) [noise=true , address=145.79.227.11:4735 , piece_id=5PPOJQA3Q27KNYK5WERDD4HB5JQI6OUFCTKHAINUHGAWJM3TMAUA, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.374487485 (80h18m10.96859874s) [noise=true , address=145.79.227.18:4007 , piece_id=WJV35MXAUG7SKKJWEIWAIESYUAF7RBDKLJDN33IPMHB5N6DGH4GQ, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.375321756 (80h18m10.969433008s) [noise=true , address=145.79.227.10:4406 , piece_id=FPTCGHEHKCIOUR6BPDMC4WHJ4PTT2JJUBXNERDPOX3INNDF55PIA, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.375340766 (80h18m10.96945202s) [noise=true , address=145.79.227.3:4155 , piece_id=OJBAUS4GZJ2HJWASBN7HHMFFZWGMMFCQ2NTMZKLH7WRXEABEX3YQ, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.375936318 (80h18m10.970047562s) [noise=true , address=145.79.227.8:4333 , piece_id=M2S6NWYPVT7K2K6EWGCWIQ6P2NN3H2WX76FSIYWMWBG46OJKPXLA, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.376495742 (80h18m10.970606991s) [noise=true , address=145.79.227.26:4656 , piece_id=U7MEVMGVI445LPQRF6QU7ULMGP3XO2Q2AZCEZFCFNBOY7AGDNTZA, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.377154234 (80h18m10.971265483s) [noise=true , address=145.79.227.23:4548 , piece_id=SAKWDPNLFQTRXXSMDCEBDNDYQ3RFMGKQQWS3SOV5RX6HXPPCBWFQ, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.377648965 (80h18m10.971760213s) [noise=true , address=145.79.227.2:4117 , piece_id=M4PDDDSSUFGMZ4KSDPLDJKJ4664EXCF2FSFMU3QJM6BSDJISOJ2Q, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.378208308 (80h18m10.972319557s) [noise=true , address=145.79.227.17:4973 , piece_id=ZSQS66X7ALUUDLCXQZCRODCPM5RZJLL3IONGIAS3AQNSOHLVQKOQ, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.378757378 (80h18m10.972868628s) [noise=true , address=145.79.227.24:4587 , piece_id=QQREMOR7HRYO3DZ6KSXGIAPTEIH2BOZKZ4V2WFXAG5GTUXBBBQ5A, seg_pos={0 0}, upload=77072]: Uploading piece...
Apr 11 00:35:00.983930435 (80h18m11.578041665s) [upload=77072]: Next returned nil segment
Apr 11 00:35:00.983944203 (80h18m11.578055442s) [upload=77072]: Waiting for error group managing segments...
Apr 11 00:35:01.134409156 (80h18m11.728520408s) [noise=true , address=77.90.31.10:4521 , piece_id=6SCV5N6AGREFBEL6BDERSPNONZ2MAZVS2D2KOBHQWNF3OAORDJJQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: <nil>
Apr 11 00:35:29.994632460 (80h18m40.588743705s) [noise=true , address=145.79.227.17:4973 , piece_id=ZSQS66X7ALUUDLCXQZCRODCPM5RZJLL3IONGIAS3AQNSOHLVQKOQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:12afPNc97E17nBKr8sz5ujCrrVry16s6e28MEduErC2CRshtv9d, address:145.79.227.17:4973): protocol: rpc: dial tcp 145.79.227.17:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.994780093 (80h18m40.588891406s) [noise=true , address=145.79.227.42:4125 , piece_id=OJHNS4DNAZHGOYJBY65VPW3ZTZV3STCWRITROLF2FM6VJTCWSW5A, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1MrdHwiDVe8m6wcaQJrYetza9qckLruJXiU9UYbMxGCSWWMV1S, address:145.79.227.42:4125): protocol: rpc: dial tcp 145.79.227.42:4125: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.994896517 (80h18m40.589007758s) [noise=true , address=145.79.227.23:4548 , piece_id=SAKWDPNLFQTRXXSMDCEBDNDYQ3RFMGKQQWS3SOV5RX6HXPPCBWFQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, address:145.79.227.23:4548): protocol: rpc: dial tcp 145.79.227.23:4548: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.994993361 (80h18m40.589104603s) [noise=true , address=145.79.227.18:4007 , piece_id=WJV35MXAUG7SKKJWEIWAIESYUAF7RBDKLJDN33IPMHB5N6DGH4GQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995047768 (80h18m40.589159012s) [noise=true , address=145.79.227.24:4587 , piece_id=QQREMOR7HRYO3DZ6KSXGIAPTEIH2BOZKZ4V2WFXAG5GTUXBBBQ5A, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY, address:145.79.227.24:4587): protocol: rpc: dial tcp 145.79.227.24:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995254968 (80h18m40.589366211s) [noise=true , address=145.79.227.8:4333 , piece_id=M2S6NWYPVT7K2K6EWGCWIQ6P2NN3H2WX76FSIYWMWBG46OJKPXLA, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995277748 (80h18m40.589388974s) [noise=true , address=145.79.227.3:4155 , piece_id=OJBAUS4GZJ2HJWASBN7HHMFFZWGMMFCQ2NTMZKLH7WRXEABEX3YQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1yiUBiCEpAs5yDmgVfFGuxgW4R53jzMJugo8Piff3p79EEZdWr, address:145.79.227.3:4155): protocol: rpc: dial tcp 145.79.227.3:4155: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995448471 (80h18m40.589559712s) [noise=true , address=145.79.227.14:4843 , piece_id=7JXX65HEKLZYB7VKJBRRZWM5W4S5FAKK3FL2N4U4PFBI4D6FVS5A, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:12HvL2JDP4GCsu3tziVEKRMh14nEzyRMRuWNSmVvs27LzHTbNpS, address:145.79.227.14:4843): protocol: rpc: dial tcp 145.79.227.14:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995473629 (80h18m40.589584879s) [noise=true , address=145.79.227.26:4656 , piece_id=U7MEVMGVI445LPQRF6QU7ULMGP3XO2Q2AZCEZFCFNBOY7AGDNTZA, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j, address:145.79.227.26:4656): protocol: rpc: dial tcp 145.79.227.26:4656: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995627984 (80h18m40.589739227s) [noise=true , address=145.79.227.52:4449 , piece_id=ZI26P3UU63SLCYJYC7LGJT7HKUO377TJ46KKH24K6ZJDGVVYTT5Q, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq, address:145.79.227.52:4449): protocol: rpc: dial tcp 145.79.227.52:4449: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995797937 (80h18m40.589909181s) [noise=true , address=145.79.227.21:4477 , piece_id=B7UQ2ZKHPO6UO3XUKWQJ4QBGWGETKL7ZXV55XKD3HEXFOTVEVYKA, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1QNztqPaSGyZVsQihaj9YjG9C1nzKi1crfSDjDHimYboYAKWZY, address:145.79.227.21:4477): protocol: rpc: dial tcp 145.79.227.21:4477: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995857904 (80h18m40.589969146s) [noise=true , address=145.79.227.5:4226 , piece_id=UUAR74XECWPG44CT23IEAIY4GM4FWW6RJVDMAGVQHCTDNWPXPWQQ, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt, address:145.79.227.5:4226): protocol: rpc: dial tcp 145.79.227.5:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.995985455 (80h18m40.590096701s) [noise=true , address=145.79.227.11:4735 , piece_id=5PPOJQA3Q27KNYK5WERDD4HB5JQI6OUFCTKHAINUHGAWJM3TMAUA, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:125ShGXckiJ3N5UWVmsMdhj98oFaRN7sg1KRucyUzqENW4Jp4kS, address:145.79.227.11:4735): protocol: rpc: dial tcp 145.79.227.11:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.996081576 (80h18m40.590192818s) [noise=true , address=145.79.227.2:4117 , piece_id=M4PDDDSSUFGMZ4KSDPLDJKJ4664EXCF2FSFMU3QJM6BSDJISOJ2Q, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:122Htg72f5eUUutf1p3fYQpy1Wkf6AgdaQV83HHYye2n8zm3the, address:145.79.227.2:4117): protocol: rpc: dial tcp 145.79.227.2:4117: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.996245417 (80h18m40.59035666s) [noise=true , address=145.79.227.10:4406 , piece_id=FPTCGHEHKCIOUR6BPDMC4WHJ4PTT2JJUBXNERDPOX3INNDF55PIA, seg_pos={0 0}, upload=77072]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:35:29.996414569 (80h18m40.590525798s) [seg_pos={0 0}, upload=77072]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 11 00:35:30.094289918 (80h18m40.688401168s) [upload=77072]: Done uploading segments...
Apr 11 00:35:30.094352797 (80h18m40.688464046s) [upload=77072]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 30.101546287s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..........................................................XX] duration:
5.001251839s trace:
https://jaeger.dev.storj.io/trace/62f95f2197417e9a
FAIL (2026-04-11 00:35:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001274915s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.000895319s trace:
https://jaeger.dev.storj.io/trace/34577f1b1ae89b81
FAIL (2026-04-11 00:34:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000923497s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
2.332700387s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:55:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.332860375s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [XX..........................................................] duration:
1.610059028s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:55:26 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.610084374s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.XX.........................................................] duration:
1.741563032s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:55:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.74168582s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [X.XX........................................................] duration:
1.723747794s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:53:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.72377573s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.X.XX.......................................................] duration:
1.684404177s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:53:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.684438052s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [X.X.XX......................................................] duration:
2.007628945s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:52:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.00765811s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.X.X.XX.....................................................] duration:
1.660620537s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:51:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.660645314s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [X.X.X.XX....................................................] duration:
1.750267225s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:51:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.750298688s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.X.X.X.XX...................................................] duration:
1.692339134s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:50:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.692367255s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [..X.X.X.XX..................................................] duration:
2.056779721s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:49:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.056819991s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [...X.X.X.XX.................................................] duration:
2.628118754s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:48:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.628160473s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [X...X.X.X.XX................................................] duration:
1.618052104s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:47:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.618077254s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [.X...X.X.X.XX...............................................] duration:
1.648406204s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:47:30 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.648433058s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [X.X...X.X.X.XX..............................................] duration:
2.200866902s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:46:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.200898715s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.X.X...X.X.X.XX.............................................] duration:
1.697702865s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:45:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.697776063s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [..X.X...X.X.X.XX............................................] duration:
1.586747592s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:44:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.586769544s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [...X.X...X.X.X.XX...........................................] duration:
1.606274691s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:44:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.606306519s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [....X.X...X.X.X.XX..........................................] duration:
1.622005701s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:43:22 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.622035935s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.....X.X...X.X.X.XX.........................................] duration:
2.122773414s trace:
https://jaeger.dev.storj.io/trace/1b581910710071fc
FAIL (2026-04-10 19:42:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.122798279s
core
uplink
us-select-1
us1-placement-20
|