Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
903.644739ms
FAIL (2025-07-06 20:03:21 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 903.712473ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
869.913074ms
FAIL (2025-07-06 20:02:57 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 869.945905ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000844816s
FAIL (2025-07-06 20:02:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 3]: Starting upload Jul 6 19:53:17.696182921 (322h42m17.57959654s) [upload=258043]: Done starting upload Jul 6 19:53:17.696284637 (322h42m17.579698255s) [upload=258043]: Uploading segments... Jul 6 19:53:17.696369389 (322h42m17.579783026s) [upload=258043]: Got next segment. Inline: true Jul 6 19:53:17.696377435 (322h42m17.579791049s) [upload=258043]: Waiting for error group managing segments... Jul 6 19:53:17.696466044 (322h42m17.579879688s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:53:17.696473147 (322h42m17.57988678s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:53:17.696477145 (322h42m17.579890775s) [upload=258043]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:53:17.970432335 (322h42m17.853845953s) [upload=258043]: Done uploading segments... Jul 6 19:53:17.970463037 (322h42m17.853876654s) [upload=258043]: Upload finished. err: <nil> Jul 6 19:54:28.117890598 (322h43m28.001304235s) [upload=258056]: Starting upload Jul 6 19:54:28.118040723 (322h43m28.001454351s) [upload=258056]: Done starting upload Jul 6 19:54:28.118137584 (322h43m28.001551215s) [upload=258056]: Uploading segments... Jul 6 19:54:28.118206157 (322h43m28.001619804s) [upload=258056]: Got next segment. Inline: true Jul 6 19:54:28.118213125 (322h43m28.001626752s) [upload=258056]: Waiting for error group managing segments... Jul 6 19:54:28.118322406 (322h43m28.001736037s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:54:28.118330930 (322h43m28.001744559s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:54:28.118338639 (322h43m28.001752271s) [upload=258056]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:54:28.261414387 (322h43m28.144828007s) [upload=258056]: Done uploading segments... Jul 6 19:54:28.261455875 (322h43m28.144869502s) [upload=258056]: Upload finished. err: <nil> Jul 6 19:55:33.095648966 (322h44m32.979062602s) [upload=258072]: Starting upload Jul 6 19:55:33.095770766 (322h44m32.979184378s) [upload=258072]: Done starting upload Jul 6 19:55:33.095872846 (322h44m32.979286476s) [upload=258072]: Uploading segments... Jul 6 19:55:33.095943124 (322h44m32.979356764s) [upload=258072]: Got next segment. Inline: true Jul 6 19:55:33.095950360 (322h44m32.979363996s) [upload=258072]: Waiting for error group managing segments... Jul 6 19:55:33.096028365 (322h44m32.979442003s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:55:33.096034532 (322h44m32.979448172s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:55:33.096037940 (322h44m32.979451573s) [upload=258072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:55:33.243940836 (322h44m33.127354474s) [upload=258072]: Done uploading segments... Jul 6 19:55:33.243964591 (322h44m33.127378222s) [upload=258072]: Upload finished. err: <nil> Jul 6 19:56:06.282827178 (322h45m6.166240816s) [upload=258080]: Starting upload Jul 6 19:56:06.282915389 (322h45m6.166329024s) [upload=258080]: Done starting upload Jul 6 19:56:06.282997114 (322h45m6.16641074s) [upload=258080]: Uploading segments... Jul 6 19:56:06.283051835 (322h45m6.166465472s) [upload=258080]: Got next segment. Inline: true Jul 6 19:56:06.283058076 (322h45m6.166471714s) [upload=258080]: Waiting for error group managing segments... Jul 6 19:56:06.283128071 (322h45m6.166541699s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:56:06.283135188 (322h45m6.166548848s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:56:06.283139003 (322h45m6.166552639s) [upload=258080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:56:06.558416011 (322h45m6.441829649s) [upload=258080]: Done uploading segments... Jul 6 19:56:06.558456611 (322h45m6.441870248s) [upload=258080]: Upload finished. err: <nil> Jul 6 19:57:03.243636619 (322h46m3.127050256s) [upload=258090]: Starting upload Jul 6 19:57:03.243739469 (322h46m3.1271531s) [upload=258090]: Done starting upload Jul 6 19:57:03.243829805 (322h46m3.127243425s) [upload=258090]: Uploading segments... Jul 6 19:57:03.243899209 (322h46m3.127312846s) [upload=258090]: Got next segment. Inline: true Jul 6 19:57:03.243906118 (322h46m3.127319734s) [upload=258090]: Waiting for error group managing segments... Jul 6 19:57:03.243972280 (322h46m3.127385914s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:57:03.243978941 (322h46m3.127392571s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:57:03.243984529 (322h46m3.127398156s) [upload=258090]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:57:03.391652577 (322h46m3.275066197s) [upload=258090]: Done uploading segments... Jul 6 19:57:03.391672667 (322h46m3.275086288s) [upload=258090]: Upload finished. err: <nil> Jul 6 19:58:13.697516843 (322h47m13.580930472s) [upload=258104]: Starting upload Jul 6 19:58:13.697603707 (322h47m13.581021484s) [upload=258104]: Done starting upload Jul 6 19:58:13.697699228 (322h47m13.581112841s) [upload=258104]: Uploading segments... Jul 6 19:58:13.697752865 (322h47m13.5811665s) [upload=258104]: Got next segment. Inline: true Jul 6 19:58:13.697757885 (322h47m13.581171497s) [upload=258104]: Waiting for error group managing segments... Jul 6 19:58:13.697806149 (322h47m13.581219761s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:58:13.697811341 (322h47m13.581224953s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:58:13.697814082 (322h47m13.581227695s) [upload=258104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:58:13.841091745 (322h47m13.724505364s) [upload=258104]: Done uploading segments... Jul 6 19:58:13.841124196 (322h47m13.724537815s) [upload=258104]: Upload finished. err: <nil> Jul 6 19:59:16.950570012 (322h48m16.833983639s) [upload=258120]: Starting upload Jul 6 19:59:16.950641780 (322h48m16.834055397s) [upload=258120]: Done starting upload Jul 6 19:59:16.950725338 (322h48m16.834138954s) [upload=258120]: Uploading segments... Jul 6 19:59:16.950764438 (322h48m16.834178073s) [upload=258120]: Got next segment. Inline: true Jul 6 19:59:16.950770321 (322h48m16.834183938s) [upload=258120]: Waiting for error group managing segments... Jul 6 19:59:16.950824426 (322h48m16.834238042s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 19:59:16.950830204 (322h48m16.834243831s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 19:59:16.950833478 (322h48m16.834247097s) [upload=258120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 19:59:17.104935299 (322h48m16.988348934s) [upload=258120]: Done uploading segments... Jul 6 19:59:17.104971364 (322h48m16.988384977s) [upload=258120]: Upload finished. err: <nil> Jul 6 20:00:02.341189836 (322h49m2.224603454s) [upload=258131]: Starting upload Jul 6 20:00:02.341318462 (322h49m2.22473208s) [upload=258131]: Done starting upload Jul 6 20:00:02.341413922 (322h49m2.224827543s) [upload=258131]: Uploading segments... Jul 6 20:00:02.341477306 (322h49m2.224890936s) [upload=258131]: Got next segment. Inline: true Jul 6 20:00:02.341483239 (322h49m2.224896856s) [upload=258131]: Waiting for error group managing segments... Jul 6 20:00:02.341549241 (322h49m2.224962858s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:02.341556652 (322h49m2.224970271s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:02.341560867 (322h49m2.224974485s) [upload=258131]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:02.486864441 (322h49m2.370278063s) [upload=258131]: Done uploading segments... Jul 6 20:00:02.486899877 (322h49m2.370313501s) [upload=258131]: Upload finished. err: <nil> Jul 6 20:00:37.613195250 (322h49m37.496608882s) [upload=258141]: Starting upload Jul 6 20:00:37.613301342 (322h49m37.496714961s) [upload=258141]: Done starting upload Jul 6 20:00:37.613439708 (322h49m37.496853324s) [upload=258141]: Uploading segments... Jul 6 20:00:37.613500917 (322h49m37.496914546s) [upload=258141]: Got next segment. Inline: true Jul 6 20:00:37.613507575 (322h49m37.496921194s) [upload=258141]: Waiting for error group managing segments... Jul 6 20:00:37.613557129 (322h49m37.496970764s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:00:37.613563526 (322h49m37.496977156s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:00:37.613580070 (322h49m37.496993701s) [upload=258141]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:00:37.859063809 (322h49m37.742477461s) [upload=258141]: Done uploading segments... Jul 6 20:00:37.859116029 (322h49m37.742529671s) [upload=258141]: Upload finished. err: <nil> Jul 6 20:01:41.758461123 (322h50m41.641874742s) [upload=258153]: Starting upload Jul 6 20:01:41.758528267 (322h50m41.641941885s) [upload=258153]: Done starting upload Jul 6 20:01:41.758593360 (322h50m41.642006976s) [upload=258153]: Uploading segments... Jul 6 20:01:41.758636282 (322h50m41.642049918s) [upload=258153]: Got next segment. Inline: true Jul 6 20:01:41.758643400 (322h50m41.642057026s) [upload=258153]: Waiting for error group managing segments... Jul 6 20:01:41.758684317 (322h50m41.642097933s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 6 20:01:41.758689708 (322h50m41.642103327s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 6 20:01:41.758692964 (322h50m41.642106583s) [upload=258153]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 6 20:01:41.911079543 (322h50m41.794493162s) [upload=258153]: Done uploading segments... Jul 6 20:01:41.911099828 (322h50m41.794513447s) [upload=258153]: Upload finished. err: <nil>
Duration: 30.000872515s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.882111521s
FAIL (2025-07-05 22:28:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.882141274s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.946999507s
FAIL (2025-07-05 22:27:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.947026209s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.081258017s
FAIL (2025-07-05 22:26:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.081282669s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.367811907s
FAIL (2025-07-05 22:25:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.367915945s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.759126949s
FAIL (2025-07-05 22:24:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.759227739s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.748414734s
FAIL (2025-07-05 22:24:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.748459082s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.572680903s
FAIL (2025-07-05 22:23:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.572716755s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.821320512s
FAIL (2025-07-05 22:22:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.821809132s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.979978019s
FAIL (2025-07-05 22:21:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.980006462s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.793423296s
FAIL (2025-07-05 22:20:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.793452642s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
3.032434668s
FAIL (2025-07-05 22:19:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.032462793s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.556632876s
FAIL (2025-07-05 22:19:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.556668812s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.79160164s
FAIL (2025-07-05 22:18:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.791638955s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.966475928s
FAIL (2025-07-05 22:17:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.966529876s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
3.72059464s
FAIL (2025-07-05 22:16:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.720621901s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.682091923s
FAIL (2025-07-05 22:16:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.682119188s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.714283131s
FAIL (2025-07-05 22:15:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.714329426s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.837930731s
FAIL (2025-07-05 22:14:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837956872s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.931370811s
FAIL (2025-07-05 22:13:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.931396456s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.542904499s
FAIL (2025-07-05 22:13:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.542949015s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.72462887s
FAIL (2025-07-05 22:12:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.72468395s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.804964226s
FAIL (2025-07-05 22:12:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.804985873s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.0115608s
FAIL (2025-07-05 22:11:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.011593206s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.596046002s
FAIL (2025-07-05 22:10:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.59607256s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.74969187s
FAIL (2025-07-05 22:09:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749725809s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.603710872s
FAIL (2025-07-05 22:08:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.603731936s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
3.426499079s
FAIL (2025-07-05 22:08:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.426522807s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.825905525s
FAIL (2025-07-05 22:06:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.825926726s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.621279097s
FAIL (2025-07-05 22:06:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.621307814s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.791512288s
FAIL (2025-07-05 22:06:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.791544685s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.780382207s
FAIL (2025-07-05 22:05:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.780620724s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.672001307s
FAIL (2025-07-05 22:04:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.672025269s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.837464566s
FAIL (2025-07-05 22:03:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837516503s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.63585246s
FAIL (2025-07-05 22:03:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.635886259s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.917370117s
FAIL (2025-07-05 22:02:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.917481288s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.5637233s
FAIL (2025-07-05 22:02:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.563756079s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.823627261s
FAIL (2025-07-05 22:00:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.823672536s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.811674078s
FAIL (2025-07-05 22:00:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.811706827s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
449.149246ms
FAIL (2025-07-05 21:59:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 449.188398ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.750487066s
FAIL (2025-07-05 21:59:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.750517119s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
444.509866ms
FAIL (2025-07-05 21:59:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 444.565036ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
397.238983ms
FAIL (2025-07-05 21:58:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 397.278147ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.084771738s
FAIL (2025-07-05 21:58:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.084797217s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
448.663384ms
FAIL (2025-07-05 21:58:21 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 448.696894ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
465.789901ms
FAIL (2025-07-05 21:57:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 465.828292ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.81733417s
FAIL (2025-07-05 21:57:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.817365279s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
445.315981ms
FAIL (2025-07-05 21:56:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 445.433124ms
core
uplink
eu-select-1
eu1-placement-15
|