Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.....................X..............] duration:
824.402537ms
FAIL (2025-08-08 01:53:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 824.459577ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.....................X.............] duration:
822.55081ms
FAIL (2025-08-08 01:52:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 822.579692ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.....................X............] duration:
900.668214ms
FAIL (2025-08-08 01:51:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 900.769521ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.....................X...........] duration:
828.265397ms
FAIL (2025-08-08 01:50:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 828.293862ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.....................X..........] duration:
852.447566ms
FAIL (2025-08-08 01:49:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 852.512571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.....................X.........] duration:
842.564356ms
FAIL (2025-08-08 01:49:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 842.618196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.....................X........] duration:
862.35798ms
FAIL (2025-08-08 01:48:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 862.387939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.....................X.......] duration:
852.097875ms
FAIL (2025-08-08 01:47:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 852.138684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.....................X......] duration:
1.034131994s
FAIL (2025-08-08 01:46:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 1.034164722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.....................X.....] duration:
904.253853ms
FAIL (2025-08-08 01:45:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 904.291419ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.....................X....] duration:
835.985605ms
FAIL (2025-08-08 01:44:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 836.021371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.....................X...] duration:
825.363889ms
FAIL (2025-08-08 01:43:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 825.387801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.....................X..] duration:
885.194996ms
FAIL (2025-08-08 01:43:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 885.269803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.....................X.] duration:
848.15919ms
FAIL (2025-08-08 01:42:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 848.188075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.....................X] duration:
834.847135ms
FAIL (2025-08-08 01:41:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 834.878363ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
837.086393ms
FAIL (2025-08-08 01:40:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 837.124828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.479917466s
FAIL (2025-08-08 01:40:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.479953941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.564435111s
FAIL (2025-08-08 01:39:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.564468624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
913.15513ms
FAIL (2025-08-08 01:39:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 913.194239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.548197062s
FAIL (2025-08-08 01:38:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.548227375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
871.544483ms
FAIL (2025-08-08 01:38:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 871.580301ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.423300996s
FAIL (2025-08-08 01:38:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.423335949s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.449717043s
FAIL (2025-08-08 01:38:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.44974462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
875.696312ms
FAIL (2025-08-08 01:38:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 875.72788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
904.148035ms
FAIL (2025-08-08 01:37:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 904.187768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.925711112s
FAIL (2025-08-08 01:37:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.925761675s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
843.874817ms
FAIL (2025-08-08 01:36:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 843.930659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.792265511s
FAIL (2025-08-08 01:35:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.792291726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.194719129s
FAIL (2025-08-08 01:35:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 1.194745622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
839.329574ms
FAIL (2025-08-08 01:35:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 839.365298ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
851.035538ms
FAIL (2025-08-08 01:34:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 851.088517ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.538832114s
FAIL (2025-08-08 01:34:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.538859257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.467877633s
FAIL (2025-08-08 01:34:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.467901229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..............................................X............] duration:
952.960126ms
FAIL (2025-08-08 01:34:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 953.011654ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.318424812s
FAIL (2025-08-08 01:33:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.318460876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..............................................X...........] duration:
957.610099ms
FAIL (2025-08-08 01:33:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 957.643569ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration:
840.819912ms
FAIL (2025-08-08 01:32:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 840.851022ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration:
855.10484ms
FAIL (2025-08-08 01:32:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 855.143371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.392299645s
FAIL (2025-08-08 01:32:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.392340922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.393785266s
FAIL (2025-08-08 01:31:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.393821571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..............................................X........] duration:
985.031851ms
FAIL (2025-08-08 01:31:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 985.068602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...........X...............................................] duration:
2.864963101s
FAIL (2025-08-08 01:31:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.865005177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...........X..............................................] duration:
2.480449016s
FAIL (2025-08-08 01:30:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.480489483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
842.96532ms
FAIL (2025-08-08 01:30:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 842.996388ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...........X.............................................] duration:
2.489409267s
FAIL (2025-08-08 01:30:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.489447439s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...........X............................................] duration:
2.462869566s
FAIL (2025-08-08 01:29:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.462906814s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..............................................X......] duration:
839.973066ms
FAIL (2025-08-08 01:29:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 840.00482ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...........X...........................................] duration:
2.48782041s
FAIL (2025-08-08 01:29:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
39 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.776958241 (15h14m45.521015101s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777084661 (15h14m45.521141535s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777488740 (15h14m45.521545612s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.777882515 (15h14m45.521939385s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778319019 (15h14m45.522375888s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778727932 (15h14m45.522784802s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.778832836 (15h14m45.522889696s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779380678 (15h14m45.523437541s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.779692672 (15h14m45.523749532s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.780088972 (15h14m45.524145835s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.781085366 (15h14m45.525142236s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782018805 (15h14m45.52607567s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782244290 (15h14m45.526301157s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782572063 (15h14m45.526628926s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.782901771 (15h14m45.526958629s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.783700962 (15h14m45.527757826s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:23.784416617 (15h14m45.528473486s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Uploading piece...
Aug 8 00:54:24.342188779 (15h14m46.086245642s) [upload=15694]: Next returned nil segment
Aug 8 00:54:24.342210166 (15h14m46.086267031s) [upload=15694]: Waiting for error group managing segments...
Aug 8 00:54:24.500293063 (15h14m46.244349924s) [noise=true , address=104.36.82.47:4539 , piece_id=HIVIIOSTD7MEBP3QP6UQCB7NB5B73SBS2ZNGPTSFDZKZHWB4354A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.508572954 (15h14m46.252629804s) [noise=true , address=45.91.116.13:4156 , piece_id=XNRK4ALXL54SKE5NMLGALJ6YNYPPYZW4MIXORP4QAF4PK3LE7YMA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.517381733 (15h14m46.261438584s) [noise=true , address=104.36.82.54:4176 , piece_id=WBDJ2XNTWV7PB6PT6VM4J72LVUDRPETV3UICW5YF34AL27KJCPEQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.524347256 (15h14m46.268404116s) [noise=true , address=104.36.82.4:4817 , piece_id=4TUPDGAPISSKWMAT4PR6HXZGR7GKXTQMUVQUX2ZM5PZXMP75Z5GA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.535439301 (15h14m46.279496154s) [noise=true , address=104.36.82.45:4925 , piece_id=KM33BO6NN67ESJFOSCZKA776YI3OVRLDM56N4OQFAHTITYY3LELA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.554699162 (15h14m46.298756024s) [noise=true , address=104.36.82.14:4230 , piece_id=L2YWP6B6BTBLU6XWUZFF7ADTERFLSEOYFEM4TJ7DRBSQ4B3XZAKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.558217243 (15h14m46.302274093s) [noise=true , address=104.36.82.43:4848 , piece_id=OE5AYELYY5QC4FT7NEP7TQJ67ZAAQF2DW3XROF2GFQC4YHHJMDKA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.566506484 (15h14m46.310563334s) [noise=true , address=104.36.82.38:4702 , piece_id=VETJQESP5CJXFSBEIQKNZCYR5EJUNYICFQ6P3WU2ZNKCXDWYZFAA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.571838326 (15h14m46.315895177s) [noise=true , address=104.36.82.58:4265 , piece_id=32RAJFZLCDDBBDI6UBZDCIJNFC6OKLZSGUL5F5CBHUWNUJXSBO7A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.591490936 (15h14m46.335547788s) [noise=true , address=104.36.82.9:4033 , piece_id=6XBDMHCR34XSP25RNNXL7XUMVH7RHUNOQHIK5WAGT3LGVQFJW3BQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.593728651 (15h14m46.337785504s) [noise=true , address=104.36.82.62:4414 , piece_id=5PKH5XEWYFBIQYHC2YEBHN745RQRNKNZU3UGEZNCOIM32EQ5FP4A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.607923201 (15h14m46.351980048s) [noise=true , address=104.36.82.16:4309 , piece_id=5NWUSOPVH5RH3UFHWI4ADLNS5IBVTLKCYIE3OZ2RKF4EDOUEBZYA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.787780929 (15h14m46.531837783s) [noise=true , address=104.36.82.8:4985 , piece_id=L4CGO64NTGNSTADZIQEI3QG36CMATR55W5ZAWOLLRH3C53IDD7FA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819611985 (15h14m46.563668835s) [noise=true , address=104.36.82.23:4468 , piece_id=VFXHK5UEZ7NNX5II4CDCO2SFCTWBEWXRQ6WWGZOAUZBBYXZFJNZQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: <nil>
Aug 8 00:54:24.819646182 (15h14m46.563703043s) [seg_pos={0 0}, upload=15694]: Segment reached optimal threshold of 14 pieces.
Aug 8 00:54:24.819815809 (15h14m46.563872655s) [noise=true , address=79.127.201.215:4356 , piece_id=HR6LS74AD56XFGNPIRFNYO3VN3D6C4TV2XSSXRTWXHK6MVZWSYNA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819863765 (15h14m46.563920616s) [noise=true , address=64.49.13.27:4967 , piece_id=NNAEOXQEUE4DQAYX7HO7FLGAKV5DTIYWSEYW7RXZCZVZLWDBFBWA, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVt2Ze4c5jQTyqFQDsJVaZKqge6gfjwpxUZXDCx8UVcySk4r8): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819905825 (15h14m46.563962676s) [noise=true , address=64.49.13.26:4947 , piece_id=INJG3QWN6PGPIUKNOFV23MM7RZ5YMDL67KSVLVEBY5TWMDVIAXTQ, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.819996952 (15h14m46.564053802s) [noise=true , address=104.36.82.59:4317 , piece_id=QA7CTQYPRVTH5KYKFVKS2SDNMZTU23JZUCNNPAHCPNY6KIXSUB3A, seg_pos={0 0}, upload=15694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qjPfeVTW7hUd6VtE8XrhPPq2CCmYxZqxsDXps1CPGHpHahNEz): protocol: expected piece hash; context canceled; EOF
Aug 8 00:54:24.820016001 (15h14m46.56407286s) [seg_pos={0 0}, upload=15694]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 00:54:24.820102349 (15h14m46.56415921s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 00:54:24.820108760 (15h14m46.564165621s) [upload=15694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 00:54:24.972305508 (15h14m46.716362357s) [upload=15694]: Done uploading segments...
Aug 8 00:54:24.972335476 (15h14m46.716392322s) [upload=15694]: Upload finished. err: <nil>
Aug 8 00:55:36.413685148 (15h15m58.157741999s) [upload=15715]: Starting upload
Aug 8 00:55:36.413752015 (15h15m58.157808881s) [upload=15715]: Done starting upload
Aug 8 00:55:36.413834867 (15h15m58.157891719s) [upload=15715]: Uploading segments...
Aug 8 00:55:36.414079177 (15h15m58.158136027s) [upload=15715]: Got next segment. Inline: false
Aug 8 00:55:36.414142890 (15h15m58.158199736s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 00:55:36.414148366 (15h15m58.158205211s) [upload=15715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 00:55:36.501903566 (15h15m58.245960434s) [upload=15715]: Next segment err: metaclient: Too Many Requests
Aug 8 00:55:36.501997741 (15h15m58.246054607s) [upload=15715]: Done uploading segments...
Aug 8 00:55:36.502012925 (15h15m58.246069776s) [upload=15715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.48785567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration:
925.68424ms
FAIL (2025-08-08 01:29:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 925.719714ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..............................................X....] duration:
822.093789ms
FAIL (2025-08-08 01:28:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
=16119]: Done uploading segments...
Aug 8 01:18:22.167544968 (15h38m43.911601831s) [upload=16119]: Upload finished. err: <nil>
Aug 8 01:18:43.968368569 (15h39m5.71242542s) [upload=16125]: Starting upload
Aug 8 01:18:43.968417073 (15h39m5.712473933s) [upload=16125]: Done starting upload
Aug 8 01:18:43.968501862 (15h39m5.712558712s) [upload=16125]: Uploading segments...
Aug 8 01:18:43.968569996 (15h39m5.712626894s) [upload=16125]: Got next segment. Inline: true
Aug 8 01:18:43.968576151 (15h39m5.712632997s) [upload=16125]: Waiting for error group managing segments...
Aug 8 01:18:43.968631517 (15h39m5.712688381s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:18:43.968637472 (15h39m5.712694334s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:18:43.968640987 (15h39m5.712697851s) [upload=16125]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:18:44.152191676 (15h39m5.896248541s) [upload=16125]: Done uploading segments...
Aug 8 01:18:44.152224439 (15h39m5.896281298s) [upload=16125]: Upload finished. err: <nil>
Aug 8 01:19:28.303488603 (15h39m50.047545453s) [upload=16138]: Starting upload
Aug 8 01:19:28.303581487 (15h39m50.047638338s) [upload=16138]: Done starting upload
Aug 8 01:19:28.303655691 (15h39m50.047712561s) [upload=16138]: Uploading segments...
Aug 8 01:19:28.303921484 (15h39m50.047978382s) [upload=16138]: Got next segment. Inline: true
Aug 8 01:19:28.303933323 (15h39m50.047990193s) [upload=16138]: Waiting for error group managing segments...
Aug 8 01:19:28.304030630 (15h39m50.048087503s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:19:28.304038244 (15h39m50.048095115s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:19:28.304041897 (15h39m50.04809877s) [upload=16138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:19:28.475948902 (15h39m50.220005772s) [upload=16138]: Done uploading segments...
Aug 8 01:19:28.475973334 (15h39m50.220030204s) [upload=16138]: Upload finished. err: <nil>
Aug 8 01:20:20.299642673 (15h40m42.043699523s) [upload=16152]: Starting upload
Aug 8 01:20:20.299695963 (15h40m42.043752816s) [upload=16152]: Done starting upload
Aug 8 01:20:20.299759837 (15h40m42.04381669s) [upload=16152]: Uploading segments...
Aug 8 01:20:20.299809652 (15h40m42.043866521s) [upload=16152]: Got next segment. Inline: true
Aug 8 01:20:20.299814615 (15h40m42.043871476s) [upload=16152]: Waiting for error group managing segments...
Aug 8 01:20:20.299873606 (15h40m42.043930467s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:20:20.299880257 (15h40m42.043937117s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:20:20.299883975 (15h40m42.043940835s) [upload=16152]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:20:20.658524738 (15h40m42.402581587s) [upload=16152]: Done uploading segments...
Aug 8 01:20:20.658545249 (15h40m42.402602099s) [upload=16152]: Upload finished. err: <nil>
Aug 8 01:21:32.921603782 (15h41m54.665660633s) [upload=16175]: Starting upload
Aug 8 01:21:32.921683614 (15h41m54.665740483s) [upload=16175]: Done starting upload
Aug 8 01:21:32.921758934 (15h41m54.665815782s) [upload=16175]: Uploading segments...
Aug 8 01:21:32.921827549 (15h41m54.665884416s) [upload=16175]: Got next segment. Inline: true
Aug 8 01:21:32.921835308 (15h41m54.665892172s) [upload=16175]: Waiting for error group managing segments...
Aug 8 01:21:32.921881568 (15h41m54.665938414s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:21:32.921886283 (15h41m54.665943129s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:21:32.921889022 (15h41m54.665945881s) [upload=16175]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:21:33.074219867 (15h41m54.818276716s) [upload=16175]: Done uploading segments...
Aug 8 01:21:33.074239559 (15h41m54.81829641s) [upload=16175]: Upload finished. err: <nil>
Aug 8 01:22:09.743137925 (15h42m31.487194785s) [upload=16185]: Starting upload
Aug 8 01:22:09.743209612 (15h42m31.487266475s) [upload=16185]: Done starting upload
Aug 8 01:22:09.743281950 (15h42m31.487338798s) [upload=16185]: Uploading segments...
Aug 8 01:22:09.743366369 (15h42m31.487423237s) [upload=16185]: Got next segment. Inline: true
Aug 8 01:22:09.743373065 (15h42m31.487429926s) [upload=16185]: Waiting for error group managing segments...
Aug 8 01:22:09.743422719 (15h42m31.48747957s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:09.743430887 (15h42m31.487487747s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:09.743436556 (15h42m31.487493417s) [upload=16185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:09.980803177 (15h42m31.724860045s) [upload=16185]: Done uploading segments...
Aug 8 01:22:09.980826963 (15h42m31.724883827s) [upload=16185]: Upload finished. err: <nil>
Aug 8 01:22:51.797718040 (15h43m13.54177491s) [upload=16197]: Starting upload
Aug 8 01:22:51.797829538 (15h43m13.541886412s) [upload=16197]: Done starting upload
Aug 8 01:22:51.797979164 (15h43m13.542036014s) [upload=16197]: Uploading segments...
Aug 8 01:22:51.798055491 (15h43m13.542112357s) [upload=16197]: Got next segment. Inline: true
Aug 8 01:22:51.798061756 (15h43m13.542118616s) [upload=16197]: Waiting for error group managing segments...
Aug 8 01:22:51.798115595 (15h43m13.542172441s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:22:51.798121380 (15h43m13.542178239s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:22:51.798124222 (15h43m13.542181081s) [upload=16197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:22:51.952080066 (15h43m13.696136926s) [upload=16197]: Done uploading segments...
Aug 8 01:22:51.952099562 (15h43m13.696156411s) [upload=16197]: Upload finished. err: <nil>
Aug 8 01:23:41.614007863 (15h44m3.358064753s) [upload=16212]: Starting upload
Aug 8 01:23:41.614085279 (15h44m3.358142158s) [upload=16212]: Done starting upload
Aug 8 01:23:41.614186221 (15h44m3.358243068s) [upload=16212]: Uploading segments...
Aug 8 01:23:41.614251780 (15h44m3.35830868s) [upload=16212]: Got next segment. Inline: true
Aug 8 01:23:41.614263653 (15h44m3.358320524s) [upload=16212]: Waiting for error group managing segments...
Aug 8 01:23:41.614326664 (15h44m3.358383533s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:23:41.614333655 (15h44m3.358390526s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:23:41.614341336 (15h44m3.358398207s) [upload=16212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:23:41.804517271 (15h44m3.548574121s) [upload=16212]: Done uploading segments...
Aug 8 01:23:41.804536698 (15h44m3.548593547s) [upload=16212]: Upload finished. err: <nil>
Aug 8 01:24:56.221232718 (15h45m17.965289588s) [upload=16233]: Starting upload
Aug 8 01:24:56.221315581 (15h45m17.965372451s) [upload=16233]: Done starting upload
Aug 8 01:24:56.221429169 (15h45m17.965486024s) [upload=16233]: Uploading segments...
Aug 8 01:24:56.221503288 (15h45m17.965560157s) [upload=16233]: Got next segment. Inline: true
Aug 8 01:24:56.221508791 (15h45m17.965565654s) [upload=16233]: Waiting for error group managing segments...
Aug 8 01:24:56.221565935 (15h45m17.965622787s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:24:56.221571359 (15h45m17.965628222s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:24:56.221574825 (15h45m17.96563169s) [upload=16233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:24:56.375771481 (15h45m18.119828341s) [upload=16233]: Done uploading segments...
Aug 8 01:24:56.375789919 (15h45m18.119846766s) [upload=16233]: Upload finished. err: <nil>
Aug 8 01:25:31.335740878 (15h45m53.079797724s) [upload=16244]: Starting upload
Aug 8 01:25:31.335781093 (15h45m53.079837939s) [upload=16244]: Done starting upload
Aug 8 01:25:31.335858917 (15h45m53.079915763s) [upload=16244]: Uploading segments...
Aug 8 01:25:31.335908493 (15h45m53.079965362s) [upload=16244]: Got next segment. Inline: true
Aug 8 01:25:31.335913342 (15h45m53.079970206s) [upload=16244]: Waiting for error group managing segments...
Aug 8 01:25:31.335962421 (15h45m53.080019267s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:31.335966734 (15h45m53.080023596s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:31.335969355 (15h45m53.080026218s) [upload=16244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:31.481060671 (15h45m53.225117518s) [upload=16244]: Done uploading segments...
Aug 8 01:25:31.481077921 (15h45m53.225134767s) [upload=16244]: Upload finished. err: <nil>
Aug 8 01:25:54.022122171 (15h46m15.766179022s) [upload=16251]: Starting upload
Aug 8 01:25:54.022183522 (15h46m15.766240385s) [upload=16251]: Done starting upload
Aug 8 01:25:54.022276506 (15h46m15.766333363s) [upload=16251]: Uploading segments...
Aug 8 01:25:54.022424376 (15h46m15.766481468s) [upload=16251]: Got next segment. Inline: true
Aug 8 01:25:54.022434994 (15h46m15.766491846s) [upload=16251]: Waiting for error group managing segments...
Aug 8 01:25:54.023112590 (15h46m15.767169468s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 01:25:54.023125807 (15h46m15.767182674s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 8 01:25:54.023131741 (15h46m15.767188608s) [upload=16251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:25:54.185652292 (15h46m15.929709156s) [upload=16251]: Done uploading segments...
Aug 8 01:25:54.185692515 (15h46m15.929749376s) [upload=16251]: Upload finished. err: <nil>
Duration: 822.120926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|