Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.125615186s target: https://us1.storj.io/login FAIL (2025-06-28 10:20:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 4.125645668s core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 712.547772ms target: https://us1.storj.io/login FAIL (2025-06-28 10:19:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 712.572709ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 927.122202ms FAIL (2025-06-28 10:18:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 927.152222ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 272.230862ms target: https://us1.storj.io/login FAIL (2025-06-28 10:18:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 272.271163ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.056968468s FAIL (2025-06-28 10:18:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.057198957s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.675051766s target: https://us1.storj.io/login FAIL (2025-06-28 10:17:26 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 1.675149586s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.025948155s FAIL (2025-06-28 10:17:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.025988714s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 854.146172ms FAIL (2025-06-28 10:16:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 854.182292ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 965.094175ms target: https://us1.storj.io/login FAIL (2025-06-28 10:16:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 965.123685ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 270.44395ms target: https://us1.storj.io/login FAIL (2025-06-28 10:16:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 270.476701ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 863.777493ms FAIL (2025-06-28 10:15:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 863.80481ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 278.102225ms target: https://us1.storj.io/login FAIL (2025-06-28 10:15:30 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 278.138582ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 952.86964ms FAIL (2025-06-28 10:15:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 952.896134ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 700.552896ms target: https://us1.storj.io/login FAIL (2025-06-28 10:14:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 700.589669ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 298.788282ms target: https://us1.storj.io/login FAIL (2025-06-28 10:14:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 298.814113ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.054291281s FAIL (2025-06-28 10:14:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.054323148s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 997.647305ms target: https://us1.storj.io/login FAIL (2025-06-28 10:13:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 997.726576ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 840.349953ms FAIL (2025-06-28 10:12:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 840.457228ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 782.524834ms target: https://us1.storj.io/login FAIL (2025-06-28 10:12:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 782.559687ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 405.393677ms target: https://us1.storj.io/login FAIL (2025-06-28 10:12:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 405.430395ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 876.933378ms FAIL (2025-06-28 10:12:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 876.964101ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 737.463101ms target: https://us1.storj.io/login FAIL (2025-06-28 10:11:07 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 737.494794ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.069881436s FAIL (2025-06-28 10:11:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.069911739s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 265.888454ms target: https://us1.storj.io/login FAIL (2025-06-28 10:10:39 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 265.913457ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 987.02579ms FAIL (2025-06-28 10:10:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 987.060696ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 866.444308ms FAIL (2025-06-28 10:09:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 866.479316ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 654.421224ms target: https://us1.storj.io/login FAIL (2025-06-28 10:09:35 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 654.451938ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 876.426991ms FAIL (2025-06-28 10:09:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 876.458133ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 275.763879ms target: https://us1.storj.io/login FAIL (2025-06-28 10:09:14 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 275.826102ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 271.066479ms target: https://us1.storj.io/login FAIL (2025-06-28 10:08:41 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 271.090575ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 920.712376ms FAIL (2025-06-28 10:08:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 920.735294ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 288.395343ms target: https://us1.storj.io/login FAIL (2025-06-28 10:08:23 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 288.418752ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 913.259496ms FAIL (2025-06-28 10:08:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 913.314031ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 554.614715ms target: https://us1.storj.io/login FAIL (2025-06-28 10:07:56 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 554.648742ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 844.37705ms FAIL (2025-06-28 10:07:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 844.410494ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 268.672771ms target: https://us1.storj.io/login FAIL (2025-06-28 10:07:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 268.696165ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.069106272s FAIL (2025-06-28 10:07:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.069151678s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 274.096707ms target: https://us1.storj.io/login FAIL (2025-06-28 10:06:33 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 274.130629ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.230052362s FAIL (2025-06-28 10:06:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.230078728s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 750.821277ms target: https://us1.storj.io/login FAIL (2025-06-28 10:06:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 750.847033ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 844.107729ms FAIL (2025-06-28 10:05:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 844.141048ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.00095626s FAIL (2025-06-28 10:05:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 1.000977414s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 359.378266ms target: https://us1.storj.io/login FAIL (2025-06-28 10:05:09 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 359.412457ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 327.833594ms target: https://us1.storj.io/login FAIL (2025-06-28 10:04:47 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 327.869763ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 866.576311ms FAIL (2025-06-28 10:04:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 866.614233ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 274.532889ms target: https://us1.storj.io/login FAIL (2025-06-28 10:04:20 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 274.560309ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 927.74594ms FAIL (2025-06-28 10:04:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 927.782263ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000883842s target: https://us1.storj.io/login FAIL (2025-06-28 10:04:00 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 30.00091501s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 891.537956ms FAIL (2025-06-28 10:03:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 891.567187ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001025349s FAIL (2025-06-28 10:02:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil> Duration: 30.001051827s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)