Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 186447 reports (Page 3547 of 3729)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
916.523458ms
FAIL (2025-07-12 06:26:02 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 916.654711ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
878.89109ms
FAIL (2025-07-12 06:25:32 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 878.936095ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
920.281176ms
FAIL (2025-07-12 06:24:26 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 920.30915ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
1.139608684s
FAIL (2025-07-12 06:24:03 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.139652185s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
1.379711s
FAIL (2025-07-12 06:23:41 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.379743693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
869.701904ms
FAIL (2025-07-12 06:22:27 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 869.740715ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
1.05529419s
FAIL (2025-07-12 06:21:33 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.055519825s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
890.384261ms
FAIL (2025-07-12 06:21:02 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 890.429818ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
931.02949ms
FAIL (2025-07-12 06:20:06 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 931.076841ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
1.109705608s
FAIL (2025-07-12 06:19:38 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.109731607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
904.335983ms
FAIL (2025-07-12 06:18:51 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 904.354335ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
1.005716405s
FAIL (2025-07-12 06:17:48 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.005753496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
877.573079ms
FAIL (2025-07-12 06:17:30 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 877.604765ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
915.032237ms
FAIL (2025-07-12 06:16:26 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 915.054146ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
929.330839ms
FAIL (2025-07-12 06:15:15 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 929.36117ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
903.822649ms
FAIL (2025-07-12 06:14:51 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 903.854122ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
922.045671ms
FAIL (2025-07-12 06:13:50 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 922.076302ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
1.069570072s
FAIL (2025-07-12 06:13:19 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.06959695s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
879.41994ms
FAIL (2025-07-12 06:12:34 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 879.466159ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
888.814712ms
FAIL (2025-07-12 06:12:06 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 888.852692ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
918.298412ms
FAIL (2025-07-12 06:11:45 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 918.330781ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
893.810163ms
FAIL (2025-07-12 06:10:55 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 893.843058ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
1.006913138s
FAIL (2025-07-12 06:09:43 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.006945544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
1.089506441s
FAIL (2025-07-12 06:09:03 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 1.08961276s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
932.427508ms
FAIL (2025-07-12 06:08:42 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 932.474726ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
964.204298ms
FAIL (2025-07-12 06:08:02 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 964.236523ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
900.968548ms
FAIL (2025-07-12 06:06:52 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 901.001727ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
966.163852ms
FAIL (2025-07-12 06:05:51 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 966.259393ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
902.45187ms
FAIL (2025-07-12 06:05:12 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 902.481204ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
929.438865ms
FAIL (2025-07-12 06:04:07 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 929.512147ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
899.823144ms
FAIL (2025-07-12 06:03:47 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 899.851747ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001213899s
FAIL (2025-07-12 06:03:08 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 upload
Jul 12 05:54:05.214783366 (452h43m5.098196999s) [upload=362006]: Done starting upload
Jul 12 05:54:05.214943524 (452h43m5.098357152s) [upload=362006]: Uploading segments...
Jul 12 05:54:05.215028467 (452h43m5.098442102s) [upload=362006]: Got next segment. Inline: true
Jul 12 05:54:05.215037994 (452h43m5.098451632s) [upload=362006]: Waiting for error group managing segments...
Jul 12 05:54:05.215124043 (452h43m5.098537659s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:54:05.215133464 (452h43m5.098547098s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:54:05.215139439 (452h43m5.098553073s) [upload=362006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:54:05.350144515 (452h43m5.233558135s) [upload=362006]: Done uploading segments...
Jul 12 05:54:05.350163715 (452h43m5.233577333s) [upload=362006]: Upload finished. err: <nil>
Jul 12 05:55:07.569452170 (452h44m7.452865799s) [upload=362020]: Starting upload
Jul 12 05:55:07.569518042 (452h44m7.452931674s) [upload=362020]: Done starting upload
Jul 12 05:55:07.569617328 (452h44m7.453030949s) [upload=362020]: Uploading segments...
Jul 12 05:55:07.569709616 (452h44m7.453123251s) [upload=362020]: Got next segment. Inline: true
Jul 12 05:55:07.569715872 (452h44m7.453129498s) [upload=362020]: Waiting for error group managing segments...
Jul 12 05:55:07.569786811 (452h44m7.453200428s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:07.569794452 (452h44m7.453208079s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:07.569798041 (452h44m7.453211667s) [upload=362020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:07.734866378 (452h44m7.618280007s) [upload=362020]: Done uploading segments...
Jul 12 05:55:07.734890776 (452h44m7.618304402s) [upload=362020]: Upload finished. err: <nil>
Jul 12 05:55:42.300457718 (452h44m42.183871344s) [upload=362028]: Starting upload
Jul 12 05:55:42.300520891 (452h44m42.183934517s) [upload=362028]: Done starting upload
Jul 12 05:55:42.300586769 (452h44m42.184000387s) [upload=362028]: Uploading segments...
Jul 12 05:55:42.300630845 (452h44m42.184044481s) [upload=362028]: Got next segment. Inline: true
Jul 12 05:55:42.300636740 (452h44m42.184050367s) [upload=362028]: Waiting for error group managing segments...
Jul 12 05:55:42.300679682 (452h44m42.184093308s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:55:42.300685330 (452h44m42.184098956s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:55:42.300690591 (452h44m42.184104217s) [upload=362028]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:55:42.463812846 (452h44m42.34722647s) [upload=362028]: Done uploading segments...
Jul 12 05:55:42.463838009 (452h44m42.347251625s) [upload=362028]: Upload finished. err: <nil>
Jul 12 05:56:57.219717464 (452h45m57.103131091s) [upload=362044]: Starting upload
Jul 12 05:56:57.219777850 (452h45m57.103191475s) [upload=362044]: Done starting upload
Jul 12 05:56:57.219834673 (452h45m57.103248285s) [upload=362044]: Uploading segments...
Jul 12 05:56:57.219873712 (452h45m57.103287344s) [upload=362044]: Got next segment. Inline: true
Jul 12 05:56:57.219878315 (452h45m57.103291941s) [upload=362044]: Waiting for error group managing segments...
Jul 12 05:56:57.219916750 (452h45m57.103330376s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:56:57.219921361 (452h45m57.103334987s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:56:57.219923846 (452h45m57.103337473s) [upload=362044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:56:57.360992207 (452h45m57.244405821s) [upload=362044]: Done uploading segments...
Jul 12 05:56:57.361011314 (452h45m57.244424927s) [upload=362044]: Upload finished. err: <nil>
Jul 12 05:57:50.271258395 (452h46m50.154672025s) [upload=362059]: Starting upload
Jul 12 05:57:50.271354465 (452h46m50.154768101s) [upload=362059]: Done starting upload
Jul 12 05:57:50.271493330 (452h46m50.154906943s) [upload=362059]: Uploading segments...
Jul 12 05:57:50.271555529 (452h46m50.154969169s) [upload=362059]: Got next segment. Inline: true
Jul 12 05:57:50.271562118 (452h46m50.154975748s) [upload=362059]: Waiting for error group managing segments...
Jul 12 05:57:50.271628175 (452h46m50.155041802s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:57:50.271634604 (452h46m50.155048231s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:57:50.271638113 (452h46m50.155051741s) [upload=362059]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:57:50.409186354 (452h46m50.292599971s) [upload=362059]: Done uploading segments...
Jul 12 05:57:50.409205433 (452h46m50.292619049s) [upload=362059]: Upload finished. err: <nil>
Jul 12 05:58:40.678652401 (452h47m40.562066013s) [upload=362068]: Starting upload
Jul 12 05:58:40.678738970 (452h47m40.562152595s) [upload=362068]: Done starting upload
Jul 12 05:58:40.678889497 (452h47m40.562303117s) [upload=362068]: Uploading segments...
Jul 12 05:58:40.678996054 (452h47m40.56240969s) [upload=362068]: Got next segment. Inline: true
Jul 12 05:58:40.679005554 (452h47m40.562419189s) [upload=362068]: Waiting for error group managing segments...
Jul 12 05:58:40.679070474 (452h47m40.562484111s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:58:40.679078913 (452h47m40.562492552s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:58:40.679082385 (452h47m40.562495998s) [upload=362068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:58:40.833826911 (452h47m40.717240533s) [upload=362068]: Done uploading segments...
Jul 12 05:58:40.833854832 (452h47m40.717268447s) [upload=362068]: Upload finished. err: <nil>
Jul 12 05:59:49.818630674 (452h48m49.702044293s) [upload=362084]: Starting upload
Jul 12 05:59:49.818706003 (452h48m49.702119629s) [upload=362084]: Done starting upload
Jul 12 05:59:49.818776130 (452h48m49.702189749s) [upload=362084]: Uploading segments...
Jul 12 05:59:49.818817995 (452h48m49.702231631s) [upload=362084]: Got next segment. Inline: true
Jul 12 05:59:49.818823484 (452h48m49.702237102s) [upload=362084]: Waiting for error group managing segments...
Jul 12 05:59:49.818866953 (452h48m49.702280572s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 05:59:49.818872937 (452h48m49.702286559s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 05:59:49.818876156 (452h48m49.702289774s) [upload=362084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 05:59:49.954529961 (452h48m49.837943576s) [upload=362084]: Done uploading segments...
Jul 12 05:59:49.954554066 (452h48m49.837967679s) [upload=362084]: Upload finished. err: <nil>
Jul 12 06:00:43.495779457 (452h49m43.379193083s) [upload=362094]: Starting upload
Jul 12 06:00:43.495850292 (452h49m43.379263908s) [upload=362094]: Done starting upload
Jul 12 06:00:43.495941322 (452h49m43.379354938s) [upload=362094]: Uploading segments...
Jul 12 06:00:43.495995120 (452h49m43.379408751s) [upload=362094]: Got next segment. Inline: true
Jul 12 06:00:43.496003010 (452h49m43.379416636s) [upload=362094]: Waiting for error group managing segments...
Jul 12 06:00:43.496057483 (452h49m43.379471109s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:00:43.496063525 (452h49m43.379477152s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:00:43.496067040 (452h49m43.379480666s) [upload=362094]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:00:43.751058267 (452h49m43.634471902s) [upload=362094]: Done uploading segments...
Jul 12 06:00:43.751086051 (452h49m43.634499678s) [upload=362094]: Upload finished. err: <nil>
Jul 12 06:01:18.554885710 (452h50m18.438299339s) [upload=362102]: Starting upload
Jul 12 06:01:18.554992486 (452h50m18.438406114s) [upload=362102]: Done starting upload
Jul 12 06:01:18.555064908 (452h50m18.438478539s) [upload=362102]: Uploading segments...
Jul 12 06:01:18.555161420 (452h50m18.438575056s) [upload=362102]: Got next segment. Inline: true
Jul 12 06:01:18.555187002 (452h50m18.43860063s) [upload=362102]: Waiting for error group managing segments...
Jul 12 06:01:18.555244054 (452h50m18.438657683s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:18.555267160 (452h50m18.43868079s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:18.555270932 (452h50m18.438684562s) [upload=362102]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:18.943647504 (452h50m18.827061125s) [upload=362102]: Done uploading segments...
Jul 12 06:01:18.943667489 (452h50m18.827081107s) [upload=362102]: Upload finished. err: <nil>
Jul 12 06:01:35.111458191 (452h50m34.99487181s) [upload=362106]: Starting upload
Jul 12 06:01:35.111534761 (452h50m34.994948387s) [upload=362106]: Done starting upload
Jul 12 06:01:35.111619484 (452h50m34.995033103s) [upload=362106]: Uploading segments...
Jul 12 06:01:35.111668242 (452h50m34.995081877s) [upload=362106]: Got next segment. Inline: true
Jul 12 06:01:35.111674298 (452h50m34.995087925s) [upload=362106]: Waiting for error group managing segments...
Jul 12 06:01:35.111731613 (452h50m34.995145231s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 12 06:01:35.111738659 (452h50m34.995152284s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Jul 12 06:01:35.111741973 (452h50m34.9951556s) [upload=362106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 12 06:01:35.268624606 (452h50m35.152038225s) [upload=362106]: Done uploading segments...
Jul 12 06:01:35.268672244 (452h50m35.152085874s) [upload=362106]: Upload finished. err: <nil>
Duration: 30.001258426s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [X..............]
duration:
123.900831ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-12 00:02:27 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 123.926199ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [.X.............]
duration:
112.973337ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-12 00:02:02 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 113.010687ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [..X............]
duration:
96.620682ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-12 00:01:12 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 96.648197ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [X..............]
duration:
227.173026ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-12 00:00:45 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 227.204968ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [...X...........]
duration:
108.313628ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-12 00:00:07 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 108.365989ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [.X.............]
duration:
233.296912ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:59:36 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 233.312874ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [..X............]
duration:
202.459677ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:59:20 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 202.48867ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [....X..........]
duration:
113.123422ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:59:08 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 113.152906ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [...X...........]
duration:
7.427053653s
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:58:46 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 7.427084462s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [.....X.........]
duration:
10.153766362s
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:58:38 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 10.153794643s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [......X........]
duration:
107.97872ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:58:01 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 108.003416ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [....X..........]
duration:
195.299169ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:57:42 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 195.324722ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [.....X.........]
duration:
210.569224ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:57:21 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 210.596088ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [.......X.......]
duration:
102.091824ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:56:54 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 102.120505ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [........X......]
duration:
92.666727ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:56:13 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 92.693606ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [......X........]
duration:
224.103542ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:56:10 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 224.131311ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [.......X.......]
duration:
193.467975ms
remote:
"tcp:15.161.34.42:443"
target:
https://www.storj.io/dcs-satellites
FAIL (2025-07-11 23:55:21 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp 139.59.144.22:39346->15.161.34.42:443: read: connection reset by peer
Duration: 193.492244ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [.........X.....]
duration:
134.644788ms
remote:
"tcp:35.152.117.67:443"
target:
https://www.storj.io/
FAIL (2025-07-11 23:55:06 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp 139.59.144.22:52096->35.152.117.67:443: read: connection reset by peer
Duration: 134.676454ms core website