Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
964.932022ms
FAIL (2025-07-06 20:26:17 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 964.963168ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
868.990258ms
FAIL (2025-07-06 20:25:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 869.026167ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
868.810639ms
FAIL (2025-07-06 20:24:48 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 868.847393ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.050499587s
FAIL (2025-07-06 20:24:08 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.050532873s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
834.659395ms
FAIL (2025-07-06 20:22:54 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 834.693ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.141121295s
FAIL (2025-07-06 20:21:56 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.141153714s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
930.505194ms
FAIL (2025-07-06 20:21:02 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 930.561141ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
879.906069ms
FAIL (2025-07-06 20:20:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 879.940116ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
932.13069ms
FAIL (2025-07-06 20:19:45 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 932.178347ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.047014984s
FAIL (2025-07-06 20:18:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.047045193s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
852.586723ms
FAIL (2025-07-06 20:18:11 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 852.624024ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
869.984329ms
FAIL (2025-07-06 20:17:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 870.016865ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
859.061422ms
FAIL (2025-07-06 20:16:38 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 859.109449ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.127326093s
FAIL (2025-07-06 20:15:46 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.127365165s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
927.185191ms
FAIL (2025-07-06 20:14:43 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 927.218908ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
857.258551ms
FAIL (2025-07-06 20:13:33 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 857.281856ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.031339774s
FAIL (2025-07-06 20:13:06 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.03139497s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
867.661721ms
FAIL (2025-07-06 20:12:40 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 867.699164ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
850.422621ms
FAIL (2025-07-06 20:11:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 850.453032ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
929.675586ms
FAIL (2025-07-06 20:11:17 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 929.714223ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
859.442499ms
FAIL (2025-07-06 20:10:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 859.476005ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
877.115696ms
FAIL (2025-07-06 20:08:51 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 877.166844ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
880.686086ms
FAIL (2025-07-06 20:08:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 880.718647ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
853.367072ms
FAIL (2025-07-06 20:06:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 853.402913ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
850.545572ms
FAIL (2025-07-06 20:05:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 850.588126ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
864.566675ms
FAIL (2025-07-06 20:05:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 864.600338ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.109107981s
FAIL (2025-07-06 20:05:03 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 1.109229677s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
863.412052ms
FAIL (2025-07-06 20:04:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 863.464197ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
895.027546ms
FAIL (2025-07-06 20:03:49 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 895.057932ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
903.644739ms
FAIL (2025-07-06 20:03:21 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 903.712473ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
869.913074ms
FAIL (2025-07-06 20:02:57 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 869.945905ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000844816s
FAIL (2025-07-06 20:02:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 30.000872515s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.882111521s
FAIL (2025-07-05 22:28:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.882141274s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.946999507s
FAIL (2025-07-05 22:27:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.947026209s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.081258017s
FAIL (2025-07-05 22:26:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.081282669s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.367811907s
FAIL (2025-07-05 22:25:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.367915945s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.759126949s
FAIL (2025-07-05 22:24:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.759227739s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.748414734s
FAIL (2025-07-05 22:24:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.748459082s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.572680903s
FAIL (2025-07-05 22:23:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.572716755s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.821320512s
FAIL (2025-07-05 22:22:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.821809132s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.979978019s
FAIL (2025-07-05 22:21:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.980006462s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.793423296s
FAIL (2025-07-05 22:20:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.793452642s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
3.032434668s
FAIL (2025-07-05 22:19:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.032462793s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.556632876s
FAIL (2025-07-05 22:19:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.556668812s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.79160164s
FAIL (2025-07-05 22:18:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.791638955s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.966475928s
FAIL (2025-07-05 22:17:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.966529876s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
3.72059464s
FAIL (2025-07-05 22:16:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.720621901s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.682091923s
FAIL (2025-07-05 22:16:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.682119188s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.714283131s
FAIL (2025-07-05 22:15:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.714329426s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.837930731s
FAIL (2025-07-05 22:14:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837956872s
edge
gateway
us-select-1
|