Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
861.889528ms
FAIL (2025-06-28 10:37:51 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 861.914251ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
878.003126ms
FAIL (2025-06-28 10:37:33 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 878.031232ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
629.393145ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:37:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 629.422635ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
852.600681ms
FAIL (2025-06-28 10:37:00 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 852.635738ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
907.972571ms
FAIL (2025-06-28 10:36:30 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 907.99687ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
282.31972ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:36:25 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 282.349207ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
859.952533ms
FAIL (2025-06-28 10:35:46 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 860.012602ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
3.339253012s target:
https://us1.storj.io/login
FAIL (2025-06-28 10:35:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 3.339303116s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
890.531529ms
FAIL (2025-06-28 10:35:20 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 890.564562ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
994.09202ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:34:45 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 994.115639ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
826.380783ms
FAIL (2025-06-28 10:34:21 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 826.48901ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
603.467337ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:34:17 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 603.491809ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
882.734706ms
FAIL (2025-06-28 10:33:28 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 882.778083ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
268.033151ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:33:16 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 268.063432ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
915.79799ms
FAIL (2025-06-28 10:33:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 915.850466ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
411.695681ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:32:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 411.78725ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
873.740495ms
FAIL (2025-06-28 10:32:01 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 873.795509ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
274.599895ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:31:56 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.679783ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
900.595831ms
FAIL (2025-06-28 10:31:33 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 900.700823ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
877.691693ms
FAIL (2025-06-28 10:30:46 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 877.72394ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
273.787762ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:30:41 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 273.81459ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.144468073s
FAIL (2025-06-28 10:30:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 1.144502863s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
602.641415ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:29:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 602.724014ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
897.149286ms
FAIL (2025-06-28 10:29:23 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 897.245309ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
274.339566ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:29:00 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.413158ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
270.708852ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:28:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 270.732778ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
850.179076ms
FAIL (2025-06-28 10:28:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 850.207973ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
274.926618ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:28:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.959216ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
713.188721ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:27:43 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 713.22665ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
865.336628ms
FAIL (2025-06-28 10:27:35 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 865.383317ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
276.704604ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:27:05 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 276.793291ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
940.460613ms
FAIL (2025-06-28 10:26:23 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 940.4874ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
741.313225ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:25:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 741.341976ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
859.160882ms
FAIL (2025-06-28 10:25:41 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 859.18767ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
879.173273ms
FAIL (2025-06-28 10:25:00 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 879.201835ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
435.001777ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:24:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 435.029988ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
903.373234ms
FAIL (2025-06-28 10:23:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 903.404764ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
277.489553ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:23:42 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 277.527079ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
946.919922ms
FAIL (2025-06-28 10:23:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 946.948198ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
265.555693ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:22:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 265.587068ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
876.912929ms
FAIL (2025-06-28 10:22:30 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.946226ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
885.327748ms
FAIL (2025-06-28 10:22:14 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 885.364821ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
906.164751ms
FAIL (2025-06-28 10:21:53 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 906.195107ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
271.498147ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:21:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 271.520313ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
876.525834ms
FAIL (2025-06-28 10:21:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.619761ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
267.683255ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:21:10 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 267.708999ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
848.1485ms
FAIL (2025-06-28 10:20:42 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 848.176839ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
865.28726ms
FAIL (2025-06-28 10:20:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 865.339343ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.125615186s target:
https://us1.storj.io/login
FAIL (2025-06-28 10:20:05 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 4.125645668s
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
712.547772ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:19:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 712.572709ms
core
satellite
us1
|