Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
859.160882ms
FAIL (2025-06-28 10:25:41 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 859.18767ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
879.173273ms
FAIL (2025-06-28 10:25:00 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 879.201835ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
435.001777ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:24:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 435.029988ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
903.373234ms
FAIL (2025-06-28 10:23:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 903.404764ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
277.489553ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:23:42 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 277.527079ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
946.919922ms
FAIL (2025-06-28 10:23:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 946.948198ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
265.555693ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:22:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 265.587068ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
876.912929ms
FAIL (2025-06-28 10:22:30 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.946226ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
885.327748ms
FAIL (2025-06-28 10:22:14 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 885.364821ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
906.164751ms
FAIL (2025-06-28 10:21:53 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 906.195107ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
271.498147ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:21:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 271.520313ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
876.525834ms
FAIL (2025-06-28 10:21:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.619761ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
267.683255ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:21:10 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 267.708999ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
848.1485ms
FAIL (2025-06-28 10:20:42 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 848.176839ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
865.28726ms
FAIL (2025-06-28 10:20:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 865.339343ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.125615186s target:
https://us1.storj.io/login
FAIL (2025-06-28 10:20:05 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 4.125645668s
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
712.547772ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:19:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 712.572709ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
927.122202ms
FAIL (2025-06-28 10:18:58 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 927.152222ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
272.230862ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:18:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 272.271163ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.056968468s
FAIL (2025-06-28 10:18:12 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 1.057198957s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.675051766s target:
https://us1.storj.io/login
FAIL (2025-06-28 10:17:26 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 1.675149586s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.025948155s
FAIL (2025-06-28 10:17:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 1.025988714s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
854.146172ms
FAIL (2025-06-28 10:16:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 854.182292ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
965.094175ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:16:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 965.123685ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
270.44395ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:16:05 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 270.476701ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
863.777493ms
FAIL (2025-06-28 10:15:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 863.80481ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
278.102225ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:15:30 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 278.138582ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
952.86964ms
FAIL (2025-06-28 10:15:14 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 952.896134ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
700.552896ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:14:36 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 700.589669ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
298.788282ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:14:18 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 298.814113ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.054291281s
FAIL (2025-06-28 10:14:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 1.054323148s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
997.647305ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:13:59 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 997.726576ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
840.349953ms
FAIL (2025-06-28 10:12:59 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 840.457228ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
782.524834ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:12:55 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 782.559687ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
405.393677ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:12:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 405.430395ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
876.933378ms
FAIL (2025-06-28 10:12:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.964101ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
737.463101ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:11:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 737.494794ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.069881436s
FAIL (2025-06-28 10:11:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 1.069911739s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
265.888454ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:10:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 265.913457ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
987.02579ms
FAIL (2025-06-28 10:10:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 987.060696ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
866.444308ms
FAIL (2025-06-28 10:09:40 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 866.479316ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
654.421224ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:09:35 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 654.451938ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
876.426991ms
FAIL (2025-06-28 10:09:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 876.458133ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
275.763879ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:09:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 275.826102ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
271.066479ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:08:41 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 271.090575ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
920.712376ms
FAIL (2025-06-28 10:08:38 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 920.735294ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
288.395343ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:08:23 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 288.418752ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
913.259496ms
FAIL (2025-06-28 10:08:06 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 913.314031ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
554.614715ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:07:56 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 554.648742ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
844.37705ms
FAIL (2025-06-28 10:07:32 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 844.410494ms
core
uplink
us-select-1
|