Orbiter History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 518.077762ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:54:09 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 518.111472ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 794.346405ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:53:22 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 794.379387ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 460.429153ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:52:47 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 460.46106ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 454.481069ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:52:10 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 454.512263ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 490.431308ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:50:58 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 490.455708ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 460.018286ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:49:46 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 460.095867ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 497.636646ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:49:08 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 497.73332ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 452.644739ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:48:08 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 452.680049ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 539.500868ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:47:34 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 539.532609ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 484.345309ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:46:33 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 484.372823ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 460.321036ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:45:45 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 460.382214ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 501.28139ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:44:38 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 501.30848ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 452.827897ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:43:46 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 452.896824ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 470.105017ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:43:21 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 470.131264ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 572.080219ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:43:03 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 572.109713ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 728.341602ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:42:28 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 728.3721ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 790.424014ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:41:27 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 790.452864ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 298.3078ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Content-Length=0 Date=Sat, 12 Jul 2025 16:41:08 GMT target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-12 16:41:08 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 298.333555ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 941.883407ms FAIL (2025-07-12 10:45:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 941.933599ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 879.720299ms FAIL (2025-07-12 10:44:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 879.761998ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 850.182885ms FAIL (2025-07-12 10:43:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 850.231441ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 873.410705ms FAIL (2025-07-12 10:42:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 873.441402ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 848.379755ms FAIL (2025-07-12 10:41:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 848.406121ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 835.658979ms FAIL (2025-07-12 10:40:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 835.689986ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 900.98538ms FAIL (2025-07-12 10:40:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 901.03236ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 850.498589ms FAIL (2025-07-12 10:39:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 850.532133ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 996.351685ms FAIL (2025-07-12 10:38:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 996.383194ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 883.178022ms FAIL (2025-07-12 10:38:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 883.20844ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 847.495889ms FAIL (2025-07-12 10:36:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 847.522974ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 887.482407ms FAIL (2025-07-12 10:36:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 887.529498ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 934.601102ms FAIL (2025-07-12 10:35:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 934.635069ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 833.800794ms FAIL (2025-07-12 10:34:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 833.845615ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 894.351418ms FAIL (2025-07-12 10:33:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 894.384644ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 936.690186ms FAIL (2025-07-12 10:33:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 936.742661ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 858.312754ms FAIL (2025-07-12 10:32:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 858.34232ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 875.538809ms FAIL (2025-07-12 10:31:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 875.670932ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 901.749084ms FAIL (2025-07-12 10:31:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 901.782233ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 891.564183ms FAIL (2025-07-12 10:30:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 891.595677ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 890.248941ms FAIL (2025-07-12 10:30:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 890.346312ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 859.240817ms FAIL (2025-07-12 10:29:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 859.268651ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 888.406327ms FAIL (2025-07-12 10:28:22 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 888.438923ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 838.88642ms FAIL (2025-07-12 10:27:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 838.924551ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 893.902148ms FAIL (2025-07-12 10:26:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 893.935867ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 920.577833ms FAIL (2025-07-12 10:26:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 920.603991ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 886.343667ms FAIL (2025-07-12 10:25:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 886.37988ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 871.32329ms FAIL (2025-07-12 10:25:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 871.353295ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 883.058681ms FAIL (2025-07-12 10:24:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 883.087198ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 877.886478ms FAIL (2025-07-12 10:24:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 877.914503ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 867.045682ms FAIL (2025-07-12 10:23:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 867.076752ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 938.375299ms FAIL (2025-07-12 10:22:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== : Starting upload Jul 12 09:54:55.149617136 (456h43m55.033030761s) [upload=365226]: Done starting upload Jul 12 09:54:55.149694303 (456h43m55.03310792s) [upload=365226]: Uploading segments... Jul 12 09:54:55.149745747 (456h43m55.033159375s) [upload=365226]: Got next segment. Inline: true Jul 12 09:54:55.149750696 (456h43m55.033164309s) [upload=365226]: Waiting for error group managing segments... Jul 12 09:54:55.149786551 (456h43m55.033200164s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:54:55.149792069 (456h43m55.033205682s) [upload=365226]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:54:55.149794752 (456h43m55.033208364s) [upload=365226]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:54:55.304909122 (456h43m55.188322754s) [upload=365226]: Done uploading segments... Jul 12 09:54:55.304931312 (456h43m55.188344948s) [upload=365226]: Upload finished. err: <nil> Jul 12 09:55:31.688941506 (456h44m31.572355136s) [upload=365232]: Starting upload Jul 12 09:55:31.689018817 (456h44m31.572432446s) [upload=365232]: Done starting upload Jul 12 09:55:31.689099781 (456h44m31.5725134s) [upload=365232]: Uploading segments... Jul 12 09:55:31.689150694 (456h44m31.572564323s) [upload=365232]: Got next segment. Inline: true Jul 12 09:55:31.689156625 (456h44m31.572570252s) [upload=365232]: Waiting for error group managing segments... Jul 12 09:55:31.689199973 (456h44m31.5726136s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:55:31.689222045 (456h44m31.572635674s) [upload=365232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:55:31.689225646 (456h44m31.572639272s) [upload=365232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:55:31.900996264 (456h44m31.784409891s) [upload=365232]: Done uploading segments... Jul 12 09:55:31.901018299 (456h44m31.784431912s) [upload=365232]: Upload finished. err: <nil> Jul 12 09:56:41.350926655 (456h45m41.234340281s) [upload=365249]: Starting upload Jul 12 09:56:41.350993235 (456h45m41.234406861s) [upload=365249]: Done starting upload Jul 12 09:56:41.351081276 (456h45m41.234494888s) [upload=365249]: Uploading segments... Jul 12 09:56:41.351129662 (456h45m41.234543297s) [upload=365249]: Got next segment. Inline: true Jul 12 09:56:41.351134559 (456h45m41.234548171s) [upload=365249]: Waiting for error group managing segments... Jul 12 09:56:41.351170020 (456h45m41.234583633s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:56:41.351174665 (456h45m41.234588277s) [upload=365249]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:56:41.351177347 (456h45m41.234590959s) [upload=365249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:56:41.509201073 (456h45m41.392614687s) [upload=365249]: Done uploading segments... Jul 12 09:56:41.509245862 (456h45m41.392659478s) [upload=365249]: Upload finished. err: <nil> Jul 12 09:57:03.893802711 (456h46m3.777216347s) [upload=365255]: Starting upload Jul 12 09:57:03.893886509 (456h46m3.777300147s) [upload=365255]: Done starting upload Jul 12 09:57:03.894244374 (456h46m3.777658005s) [upload=365255]: Uploading segments... Jul 12 09:57:03.894320826 (456h46m3.777734464s) [upload=365255]: Got next segment. Inline: true Jul 12 09:57:03.894328744 (456h46m3.777742386s) [upload=365255]: Waiting for error group managing segments... Jul 12 09:57:03.894388055 (456h46m3.777801683s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:03.894398402 (456h46m3.777812038s) [upload=365255]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:03.894402222 (456h46m3.777815855s) [upload=365255]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:04.031145630 (456h46m3.91455925s) [upload=365255]: Done uploading segments... Jul 12 09:57:04.031162832 (456h46m3.914576451s) [upload=365255]: Upload finished. err: <nil> Jul 12 09:57:46.235008108 (456h46m46.118421723s) [upload=365264]: Starting upload Jul 12 09:57:46.235134681 (456h46m46.118548315s) [upload=365264]: Done starting upload Jul 12 09:57:46.235259195 (456h46m46.118672835s) [upload=365264]: Uploading segments... Jul 12 09:57:46.235342410 (456h46m46.118756048s) [upload=365264]: Got next segment. Inline: true Jul 12 09:57:46.235349710 (456h46m46.118763338s) [upload=365264]: Waiting for error group managing segments... Jul 12 09:57:46.235406294 (456h46m46.118819908s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:57:46.235413329 (456h46m46.118826956s) [upload=365264]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:57:46.235418042 (456h46m46.118831671s) [upload=365264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:57:46.411244334 (456h46m46.294657962s) [upload=365264]: Done uploading segments... Jul 12 09:57:46.411263385 (456h46m46.294676998s) [upload=365264]: Upload finished. err: <nil> Jul 12 09:58:45.645147799 (456h47m45.528561428s) [upload=365276]: Starting upload Jul 12 09:58:45.645209345 (456h47m45.528622971s) [upload=365276]: Done starting upload Jul 12 09:58:45.645269169 (456h47m45.528682783s) [upload=365276]: Uploading segments... Jul 12 09:58:45.645308209 (456h47m45.528721844s) [upload=365276]: Got next segment. Inline: true Jul 12 09:58:45.645312533 (456h47m45.528726159s) [upload=365276]: Waiting for error group managing segments... Jul 12 09:58:45.645349909 (456h47m45.528763535s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:58:45.645354770 (456h47m45.528768395s) [upload=365276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:58:45.645357086 (456h47m45.528770712s) [upload=365276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:58:45.786444665 (456h47m45.66985829s) [upload=365276]: Done uploading segments... Jul 12 09:58:45.786465636 (456h47m45.669879263s) [upload=365276]: Upload finished. err: <nil> Jul 12 09:59:48.801535619 (456h48m48.684949239s) [upload=365292]: Starting upload Jul 12 09:59:48.801605032 (456h48m48.685018659s) [upload=365292]: Done starting upload Jul 12 09:59:48.801690907 (456h48m48.685104527s) [upload=365292]: Uploading segments... Jul 12 09:59:48.801733893 (456h48m48.68514753s) [upload=365292]: Got next segment. Inline: true Jul 12 09:59:48.801740622 (456h48m48.685154253s) [upload=365292]: Waiting for error group managing segments... Jul 12 09:59:48.801790074 (456h48m48.6852037s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 09:59:48.801795809 (456h48m48.685209435s) [upload=365292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 09:59:48.801799046 (456h48m48.685212672s) [upload=365292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 09:59:49.295085477 (456h48m49.17849911s) [upload=365292]: Done uploading segments... Jul 12 09:59:49.295125412 (456h48m49.178539028s) [upload=365292]: Upload finished. err: <nil> Jul 12 10:00:43.422496312 (456h49m43.305909941s) [upload=365306]: Starting upload Jul 12 10:00:43.422566837 (456h49m43.305980454s) [upload=365306]: Done starting upload Jul 12 10:00:43.422648044 (456h49m43.306061658s) [upload=365306]: Uploading segments... Jul 12 10:00:43.422734937 (456h49m43.306148574s) [upload=365306]: Got next segment. Inline: true Jul 12 10:00:43.422743166 (456h49m43.306156804s) [upload=365306]: Waiting for error group managing segments... Jul 12 10:00:43.422803041 (456h49m43.306216658s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:00:43.422809093 (456h49m43.306222711s) [upload=365306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:00:43.422812342 (456h49m43.306225959s) [upload=365306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:00:43.572364279 (456h49m43.455777914s) [upload=365306]: Done uploading segments... Jul 12 10:00:43.572398490 (456h49m43.455812104s) [upload=365306]: Upload finished. err: <nil> Jul 12 10:01:08.565165981 (456h50m8.448579607s) [upload=365312]: Starting upload Jul 12 10:01:08.565223259 (456h50m8.448636891s) [upload=365312]: Done starting upload Jul 12 10:01:08.565284941 (456h50m8.448698575s) [upload=365312]: Uploading segments... Jul 12 10:01:08.565324255 (456h50m8.44873789s) [upload=365312]: Got next segment. Inline: true Jul 12 10:01:08.565329767 (456h50m8.448743393s) [upload=365312]: Waiting for error group managing segments... Jul 12 10:01:08.565370213 (456h50m8.44878384s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:08.565375755 (456h50m8.44878938s) [upload=365312]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:08.565379028 (456h50m8.448792654s) [upload=365312]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:08.856266160 (456h50m8.739679798s) [upload=365312]: Done uploading segments... Jul 12 10:01:08.856285860 (456h50m8.739699488s) [upload=365312]: Upload finished. err: <nil> Jul 12 10:01:36.367080769 (456h50m36.250494387s) [upload=365320]: Starting upload Jul 12 10:01:36.367147081 (456h50m36.25056071s) [upload=365320]: Done starting upload Jul 12 10:01:36.367227641 (456h50m36.250641265s) [upload=365320]: Uploading segments... Jul 12 10:01:36.367281403 (456h50m36.250695041s) [upload=365320]: Got next segment. Inline: true Jul 12 10:01:36.367288287 (456h50m36.250701925s) [upload=365320]: Waiting for error group managing segments... Jul 12 10:01:36.367335784 (456h50m36.250749399s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 12 10:01:36.367341428 (456h50m36.250755058s) [upload=365320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 12 10:01:36.367344620 (456h50m36.25075825s) [upload=365320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 12 10:01:36.517869938 (456h50m36.401283565s) [upload=365320]: Done uploading segments... Jul 12 10:01:36.517887070 (456h50m36.401300682s) [upload=365320]: Upload finished. err: <nil> Duration: 938.406305ms core uplink us-select-1

Orbiter Check History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)