Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 398.246798ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:35:55 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 398.273657ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X..XX] duration: 447.532451ms FAIL (2025-08-19 04:35:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:35:26.100731256 (251h9m48.059828507s) [upload=261426]: Starting upload Aug 19 04:35:26.100788039 (251h9m48.059885278s) [upload=261426]: Done starting upload Aug 19 04:35:26.100980510 (251h9m48.060077747s) [upload=261426]: Uploading segments... Aug 19 04:35:26.101102431 (251h9m48.060199685s) [upload=261426]: Got next segment. Inline: true Aug 19 04:35:26.101111281 (251h9m48.060208527s) [upload=261426]: Waiting for error group managing segments... Aug 19 04:35:26.101192508 (251h9m48.06028981s) [upload=261426]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:35:26.101199574 (251h9m48.060296826s) [upload=261426]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:35:26.101203716 (251h9m48.060300968s) [upload=261426]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:35:26.268414324 (251h9m48.22751157s) [upload=261426]: Done uploading segments... Aug 19 04:35:26.268432981 (251h9m48.227530221s) [upload=261426]: Upload finished. err: metaclient: Too Many Requests Duration:* 447.557251ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 4.385891065s remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:35:14 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 4.385926003s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.....X...............X..X] duration: 2.484444217s FAIL (2025-08-19 04:34:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 19 04:34:50.677264768 (251h9m12.636362006s) [upload=261416]: Starting upload Aug 19 04:34:50.677331792 (251h9m12.636429037s) [upload=261416]: Done starting upload Aug 19 04:34:50.677481405 (251h9m12.636578642s) [upload=261416]: Uploading segments... Aug 19 04:34:50.677869736 (251h9m12.636966975s) [upload=261416]: Got next segment. Inline: false Aug 19 04:34:50.677951539 (251h9m12.637048785s) [upload=261416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:34:50.677959640 (251h9m12.637056885s) [upload=261416]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:34:50.985484560 (251h9m12.944581813s) [seg_pos={0 0}, upload=261416]: Begin upload segment... Aug 19 04:34:50.985547013 (251h9m12.944644252s) [seg_pos={0 0}, upload=261416]: Done begin upload segment. Aug 19 04:34:50.985575821 (251h9m12.944673067s) [noise=true , address=104.36.82.2:4744 , piece_id=TFEUEZB6JB6JE2ZNYRDR34AXJOXX4NTFHPCT4J42B5DHIEW7IROA, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.986053775 (251h9m12.945151029s) [noise=true , address=79.127.201.215:4354 , piece_id=BD5CTMGZ6I2ZDYVALTMVK5APV7777OYAE3KX6E6IZ4BXBBEDROWA, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.986074305 (251h9m12.945171551s) [noise=true , address=45.91.116.9:4289 , piece_id=IOAR2INHJDUQHGRMFY4KRIGWTYLEI7QBUWERUJQOMEDHY52YFL3A, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.986442491 (251h9m12.945539742s) [noise=true , address=104.36.82.5:4859 , piece_id=333IKYSWE5IMQ62UT4XG4CDNLIB6H6K2OD7FYERIDTVSCGU4ERPA, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.986592957 (251h9m12.945690212s) [noise=true , address=104.36.82.44:4890 , piece_id=DM47RC6BYDAEWMMOWHEKL6F62OPZV5XXWKZ2M34CWUOVLPMHPBWA, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.986869055 (251h9m12.945966304s) [noise=true , address=104.36.82.10:4083 , piece_id=7VS7WDCLVMNSEX23HT5I35ZPCY2YYBOI52OFJ6HJFN77LACL6CIQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987025040 (251h9m12.946122296s) [noise=true , address=77.90.31.17:4786 , piece_id=UTAPQELZ7OGIUHYCHXRIGDC3HJW6PPSOAVY2ZIP7SZ5VJPMMGAHQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987275642 (251h9m12.946372909s) [noise=true , address=45.91.116.5:4325 , piece_id=EBZEPORXXERTZVA6IYIA66ZSXKXJ6BCB7NVWKMQEYJMRXNWYOUCQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987412675 (251h9m12.946509929s) [noise=true , address=77.90.31.18:4824 , piece_id=A6AMPJYXD56JXMALXOKZBIH7CQCVEBWGPDR5EOLMPEVV5R5ILEYQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987660479 (251h9m12.94675773s) [noise=true , address=77.90.31.10:4523 , piece_id=NF4PK7CJG72DQS7V26YCKCPGMXUEHVV2UV6E33FHHIKWLPBHO57Q, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987711198 (251h9m12.946808447s) [noise=true , address=77.90.31.13:4636 , piece_id=4MEYJH2YAHDP2O45JJ7YWV647J7UXYLTXTPT44XSTW6HTGRUOV7A, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.987984435 (251h9m12.947081683s) [noise=true , address=79.127.219.38:4033 , piece_id=W6A27STBYQMYVFXRL36OJ7YKJBTMPWRCSTOEGQYQUNEV4MD5HQAQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.988035977 (251h9m12.947133228s) [noise=true , address=77.90.31.11:4579 , piece_id=GWGRVEOVTIBNRCYJ7XX6W7CFU2NHVPQBLJWIPIESICMZMPBTRCXQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.988266313 (251h9m12.947363564s) [noise=true , address=104.36.82.3:4800 , piece_id=F5SK6Y5HMSR7YNEJMCQE3PITFGTVWBIQQMZ56ACOFE5BB37S2WSQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.988538569 (251h9m12.947635817s) [noise=true , address=104.36.82.60:4369 , piece_id=KKVNV4A2HOU7C7WL7HRP5EMGGAORGQNDEPQEJOC3GJQKJU7ZU4NQ, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.988951991 (251h9m12.948049248s) [noise=true , address=66.23.193.175:4553 , piece_id=D3JG73RP2BELSUWCRQ74ZMCBUWMMMTGTU6ZUT62O7CJ4PDZLG5KA, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.989247020 (251h9m12.948344257s) [noise=true , address=104.36.82.16:4303 , piece_id=7X4HG3SEXLJ54PTI43WDXYK5MBF6NELHBG6UULJY6T7LU53JPY4Q, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:50.992021509 (251h9m12.951118747s) [noise=true , address=79.127.219.51:4211 , piece_id=HA3R7Z6VMK3KQO43IKODTRZW2UZVDXMYNSBFQXOMELJYIKV2VB7Q, seg_pos={0 0}, upload=261416]: Uploading piece... Aug 19 04:34:51.523694533 (251h9m13.482791782s) [upload=261416]: Next returned nil segment Aug 19 04:34:51.523721020 (251h9m13.482818271s) [upload=261416]: Waiting for error group managing segments... Aug 19 04:34:51.682351845 (251h9m13.641449085s) [noise=true , address=77.90.31.11:4579 , piece_id=GWGRVEOVTIBNRCYJ7XX6W7CFU2NHVPQBLJWIPIESICMZMPBTRCXQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.693941998 (251h9m13.653039238s) [noise=true , address=45.91.116.9:4289 , piece_id=IOAR2INHJDUQHGRMFY4KRIGWTYLEI7QBUWERUJQOMEDHY52YFL3A, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.703679732 (251h9m13.662776971s) [noise=true , address=104.36.82.10:4083 , piece_id=7VS7WDCLVMNSEX23HT5I35ZPCY2YYBOI52OFJ6HJFN77LACL6CIQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.711777335 (251h9m13.670874574s) [noise=true , address=45.91.116.5:4325 , piece_id=EBZEPORXXERTZVA6IYIA66ZSXKXJ6BCB7NVWKMQEYJMRXNWYOUCQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.717893311 (251h9m13.676990552s) [noise=true , address=79.127.219.38:4033 , piece_id=W6A27STBYQMYVFXRL36OJ7YKJBTMPWRCSTOEGQYQUNEV4MD5HQAQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.721187086 (251h9m13.680284332s) [noise=true , address=77.90.31.10:4523 , piece_id=NF4PK7CJG72DQS7V26YCKCPGMXUEHVV2UV6E33FHHIKWLPBHO57Q, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.722024365 (251h9m13.681121603s) [noise=true , address=104.36.82.16:4303 , piece_id=7X4HG3SEXLJ54PTI43WDXYK5MBF6NELHBG6UULJY6T7LU53JPY4Q, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.723645090 (251h9m13.682742327s) [noise=true , address=104.36.82.3:4800 , piece_id=F5SK6Y5HMSR7YNEJMCQE3PITFGTVWBIQQMZ56ACOFE5BB37S2WSQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.727318716 (251h9m13.686415955s) [noise=true , address=77.90.31.18:4824 , piece_id=A6AMPJYXD56JXMALXOKZBIH7CQCVEBWGPDR5EOLMPEVV5R5ILEYQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.735029100 (251h9m13.694126339s) [noise=true , address=104.36.82.2:4744 , piece_id=TFEUEZB6JB6JE2ZNYRDR34AXJOXX4NTFHPCT4J42B5DHIEW7IROA, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.743427189 (251h9m13.702524427s) [noise=true , address=77.90.31.17:4786 , piece_id=UTAPQELZ7OGIUHYCHXRIGDC3HJW6PPSOAVY2ZIP7SZ5VJPMMGAHQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.749622848 (251h9m13.708720094s) [noise=true , address=104.36.82.60:4369 , piece_id=KKVNV4A2HOU7C7WL7HRP5EMGGAORGQNDEPQEJOC3GJQKJU7ZU4NQ, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.756573503 (251h9m13.715670736s) [noise=true , address=79.127.219.51:4211 , piece_id=HA3R7Z6VMK3KQO43IKODTRZW2UZVDXMYNSBFQXOMELJYIKV2VB7Q, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.770031802 (251h9m13.729129037s) [noise=true , address=77.90.31.13:4636 , piece_id=4MEYJH2YAHDP2O45JJ7YWV647J7UXYLTXTPT44XSTW6HTGRUOV7A, seg_pos={0 0}, upload=261416]: Done uploading piece. err: <nil> Aug 19 04:34:51.770069774 (251h9m13.72916702s) [seg_pos={0 0}, upload=261416]: Segment reached optimal threshold of 14 pieces. Aug 19 04:34:51.770270220 (251h9m13.729367457s) [noise=true , address=104.36.82.44:4890 , piece_id=DM47RC6BYDAEWMMOWHEKL6F62OPZV5XXWKZ2M34CWUOVLPMHPBWA, seg_pos={0 0}, upload=261416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: expected piece hash; context canceled; EOF Aug 19 04:34:51.770328518 (251h9m13.729425768s) [noise=true , address=104.36.82.5:4859 , piece_id=333IKYSWE5IMQ62UT4XG4CDNLIB6H6K2OD7FYERIDTVSCGU4ERPA, seg_pos={0 0}, upload=261416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu): protocol: expected piece hash; context canceled; EOF Aug 19 04:34:51.770370343 (251h9m13.729467589s) [noise=true , address=79.127.201.215:4354 , piece_id=BD5CTMGZ6I2ZDYVALTMVK5APV7777OYAE3KX6E6IZ4BXBBEDROWA, seg_pos={0 0}, upload=261416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 19 04:34:51.770530012 (251h9m13.729627252s) [noise=true , address=66.23.193.175:4553 , piece_id=D3JG73RP2BELSUWCRQ74ZMCBUWMMMTGTU6ZUT62O7CJ4PDZLG5KA, seg_pos={0 0}, upload=261416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14ZJ9cf9uqJqtXTkP9VL2KU5YdCJfUVSyJkfRwJ6K7SpRB5zME): protocol: write tcp 139.59.144.22:38254->66.23.193.175:4553: use of closed network connection; write tcp 139.59.144.22:38254->66.23.193.175:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38254->66.23.193.175:4553: use of closed network connection Aug 19 04:34:51.770561186 (251h9m13.729658418s) [seg_pos={0 0}, upload=261416]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:34:51.770648104 (251h9m13.729745349s) [upload=261416]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:34:51.770653740 (251h9m13.729750986s) [upload=261416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:34:52.512271604 (251h9m14.471368854s) [upload=261416]: Done uploading segments... Aug 19 04:34:52.512311346 (251h9m14.47140859s) [upload=261416]: Upload finished. err: <nil> Duration: 2.484477518s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 196.655929ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:34:45 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 196.686557ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 2.225452424s FAIL (2025-08-19 04:34:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 04:34:22.654870577 (251h8m44.613967826s) [upload=261409]: Starting upload Aug 19 04:34:22.654939786 (251h8m44.614037034s) [upload=261409]: Done starting upload Aug 19 04:34:22.655046578 (251h8m44.614143818s) [upload=261409]: Uploading segments... Aug 19 04:34:22.655120960 (251h8m44.614218214s) [upload=261409]: Got next segment. Inline: true Aug 19 04:34:22.655128663 (251h8m44.614225912s) [upload=261409]: Waiting for error group managing segments... Aug 19 04:34:22.655189563 (251h8m44.61428681s) [upload=261409]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:34:22.655195478 (251h8m44.614292722s) [upload=261409]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:34:22.655199038 (251h8m44.614296283s) [upload=261409]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:34:24.395274865 (251h8m46.354372122s) [upload=261409]: Done uploading segments... Aug 19 04:34:24.395328936 (251h8m46.354426194s) [upload=261409]: Upload finished. err: <nil> Duration:* 2.225537828s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 199.83772ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:34:20 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 199.929943ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.....X...............X..] duration: 2.341524084s FAIL (2025-08-19 04:34:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:12.981031158 (251h6m34.940128414s) [upload=261368]: Starting upload Aug 19 04:32:12.981130160 (251h6m34.940227413s) [upload=261368]: Done starting upload Aug 19 04:32:12.981279156 (251h6m34.940376391s) [upload=261368]: Uploading segments... Aug 19 04:32:12.981422868 (251h6m34.940520103s) [upload=261368]: Got next segment. Inline: false Aug 19 04:32:12.981475220 (251h6m34.940572467s) [upload=261368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:12.981481156 (251h6m34.940578405s) [upload=261368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:32:13.070080030 (251h6m35.029177283s) [upload=261368]: Next segment err: metaclient: Too Many Requests Aug 19 04:32:13.070105491 (251h6m35.029202726s) [upload=261368]: Done uploading segments... Aug 19 04:32:13.070123830 (251h6m35.029221062s) [upload=261368]: Upload finished. err: metaclient: Too Many Requests Duration: 2.341582307s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.013187804s FAIL (2025-08-19 04:34:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:20.798598646 (251h6m42.757695892s) [upload=261370]: Starting upload Aug 19 04:32:20.798657303 (251h6m42.75775455s) [upload=261370]: Done starting upload Aug 19 04:32:20.798736897 (251h6m42.757834149s) [upload=261370]: Uploading segments... Aug 19 04:32:20.798824145 (251h6m42.757921394s) [upload=261370]: Got next segment. Inline: true Aug 19 04:32:20.798830236 (251h6m42.757927481s) [upload=261370]: Waiting for error group managing segments... Aug 19 04:32:20.798885251 (251h6m42.757982496s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:20.798891170 (251h6m42.757988416s) [upload=261370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:32:20.798894923 (251h6m42.757992168s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:32:20.888935510 (251h6m42.848032793s) [upload=261370]: Done uploading segments... Aug 19 04:32:20.888960197 (251h6m42.848057453s) [upload=261370]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.013239464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 370.447762ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:33:23 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 370.491978ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...................................X.....X...............X.] duration: 2.419616161s FAIL (2025-08-19 04:33:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:12.981031158 (251h6m34.940128414s) [upload=261368]: Starting upload Aug 19 04:32:12.981130160 (251h6m34.940227413s) [upload=261368]: Done starting upload Aug 19 04:32:12.981279156 (251h6m34.940376391s) [upload=261368]: Uploading segments... Aug 19 04:32:12.981422868 (251h6m34.940520103s) [upload=261368]: Got next segment. Inline: false Aug 19 04:32:12.981475220 (251h6m34.940572467s) [upload=261368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:12.981481156 (251h6m34.940578405s) [upload=261368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:32:13.070080030 (251h6m35.029177283s) [upload=261368]: Next segment err: metaclient: Too Many Requests Aug 19 04:32:13.070105491 (251h6m35.029202726s) [upload=261368]: Done uploading segments... Aug 19 04:32:13.070123830 (251h6m35.029221062s) [upload=261368]: Upload finished. err: metaclient: Too Many Requests Duration: 2.419647056s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 850.04851ms FAIL (2025-08-19 04:32:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:20.798598646 (251h6m42.757695892s) [upload=261370]: Starting upload Aug 19 04:32:20.798657303 (251h6m42.75775455s) [upload=261370]: Done starting upload Aug 19 04:32:20.798736897 (251h6m42.757834149s) [upload=261370]: Uploading segments... Aug 19 04:32:20.798824145 (251h6m42.757921394s) [upload=261370]: Got next segment. Inline: true Aug 19 04:32:20.798830236 (251h6m42.757927481s) [upload=261370]: Waiting for error group managing segments... Aug 19 04:32:20.798885251 (251h6m42.757982496s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:20.798891170 (251h6m42.757988416s) [upload=261370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:32:20.798894923 (251h6m42.757992168s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:32:20.888935510 (251h6m42.848032793s) [upload=261370]: Done uploading segments... Aug 19 04:32:20.888960197 (251h6m42.848057453s) [upload=261370]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.083587ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 378.036979ms FAIL (2025-08-19 04:32:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:20.798598646 (251h6m42.757695892s) [upload=261370]: Starting upload Aug 19 04:32:20.798657303 (251h6m42.75775455s) [upload=261370]: Done starting upload Aug 19 04:32:20.798736897 (251h6m42.757834149s) [upload=261370]: Uploading segments... Aug 19 04:32:20.798824145 (251h6m42.757921394s) [upload=261370]: Got next segment. Inline: true Aug 19 04:32:20.798830236 (251h6m42.757927481s) [upload=261370]: Waiting for error group managing segments... Aug 19 04:32:20.798885251 (251h6m42.757982496s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:20.798891170 (251h6m42.757988416s) [upload=261370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:32:20.798894923 (251h6m42.757992168s) [upload=261370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:32:20.888935510 (251h6m42.848032793s) [upload=261370]: Done uploading segments... Aug 19 04:32:20.888960197 (251h6m42.848057453s) [upload=261370]: Upload finished. err: metaclient: Too Many Requests Duration:* 378.064823ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X...................................X.....X...............X] duration: 364.009607ms FAIL (2025-08-19 04:32:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:32:12.981031158 (251h6m34.940128414s) [upload=261368]: Starting upload Aug 19 04:32:12.981130160 (251h6m34.940227413s) [upload=261368]: Done starting upload Aug 19 04:32:12.981279156 (251h6m34.940376391s) [upload=261368]: Uploading segments... Aug 19 04:32:12.981422868 (251h6m34.940520103s) [upload=261368]: Got next segment. Inline: false Aug 19 04:32:12.981475220 (251h6m34.940572467s) [upload=261368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:32:12.981481156 (251h6m34.940578405s) [upload=261368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:32:13.070080030 (251h6m35.029177283s) [upload=261368]: Next segment err: metaclient: Too Many Requests Aug 19 04:32:13.070105491 (251h6m35.029202726s) [upload=261368]: Done uploading segments... Aug 19 04:32:13.070123830 (251h6m35.029221062s) [upload=261368]: Upload finished. err: metaclient: Too Many Requests Duration: 364.036262ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 195.543642ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:32:10 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 195.577831ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...................................X.....X...............] duration: 2.442951234s FAIL (2025-08-19 04:31:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.442987704s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 193.816796ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:31:04 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 193.912406ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 191.303671ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:30:17 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 191.34296ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...................................X.....X..............] duration: 2.476921015s FAIL (2025-08-19 04:30:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.476992304s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 208.317385ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:29:23 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 208.349773ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...................................X.....X.............] duration: 2.603048895s FAIL (2025-08-19 04:28:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.603093807s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 212.956948ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:28:20 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 212.986233ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................................X.....X............] duration: 2.352393204s FAIL (2025-08-19 04:27:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.352433468s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 189.865095ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:27:09 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 189.891033ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...................................X.....X...........] duration: 2.516228101s FAIL (2025-08-19 04:27:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.516327249s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 212.856021ms remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:26:34 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 212.887454ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...................................X.....X..........] duration: 2.575505721s FAIL (2025-08-19 04:26:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.575546551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 20.050240452s remote: "tcp:15.160.106.203:443" response headers: Date=Tue, 19 Aug 2025 04:25:45 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-19 04:25:45 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 20.050262806s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...................................X.....X.........] duration: 2.42100031s FAIL (2025-08-19 04:25:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.42103202s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...................................X.....X........] duration: 2.705360095s FAIL (2025-08-19 04:25:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.705412574s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.........X...................................X.....X.......] duration: 2.877985276s FAIL (2025-08-19 04:24:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.878026227s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.........X...................................X.....X......] duration: 2.417783745s FAIL (2025-08-19 04:24:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.417818831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.........X...................................X.....X.....] duration: 2.342915455s FAIL (2025-08-19 04:23:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.342948495s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.........X...................................X.....X....] duration: 2.479861327s FAIL (2025-08-19 04:23:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.47990667s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.........X...................................X.....X...] duration: 2.355497569s FAIL (2025-08-19 04:23:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.3555666s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.........X...................................X.....X..] duration: 2.54281659s FAIL (2025-08-19 04:22:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.542880765s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.........X...................................X.....X.] duration: 2.489943748s FAIL (2025-08-19 04:22:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 2.4900286s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........X...................................X.....X] duration: 365.799344ms FAIL (2025-08-19 04:21:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:21:17.978619284 (250h55m39.937716519s) [upload=261175]: Starting upload Aug 19 04:21:17.978693584 (250h55m39.93779083s) [upload=261175]: Done starting upload Aug 19 04:21:17.978826882 (250h55m39.937924119s) [upload=261175]: Uploading segments... Aug 19 04:21:17.979069445 (250h55m39.938166694s) [upload=261175]: Got next segment. Inline: false Aug 19 04:21:17.979156359 (250h55m39.938253603s) [upload=261175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:21:17.979162597 (250h55m39.938259842s) [upload=261175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:21:18.071893277 (250h55m40.030990528s) [upload=261175]: Next segment err: metaclient: Too Many Requests Aug 19 04:21:18.071912715 (250h55m40.031009969s) [upload=261175]: Done uploading segments... Aug 19 04:21:18.071925191 (250h55m40.031022427s) [upload=261175]: Upload finished. err: metaclient: Too Many Requests Duration: 365.823602ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.........X...................................X.....] duration: 2.372803553s FAIL (2025-08-19 04:20:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.372837637s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.........X...................................X....] duration: 2.321422968s FAIL (2025-08-19 04:19:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.321449831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.........X.........X...................................X...] duration: 2.493039238s FAIL (2025-08-19 04:18:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.49307034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.........X.........X...................................X..] duration: 2.514167061s FAIL (2025-08-19 04:17:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.51422434s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 951.474832ms FAIL (2025-08-19 04:17:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a3b8a8af8256f812e06253e6d3ba448c6104f8101760b733051e91907fec0672 != before 426d0d60092cb4e5f1f8129568c2181d8de224f4ba9f5750cc98cf3b136c0060 ======LOGS====== Aug 19 03:31:05.706237698 (250h5m27.665334943s) [upload=260335]: Starting upload Aug 19 03:31:05.706288670 (250h5m27.665385916s) [upload=260335]: Done starting upload Aug 19 03:31:05.706357399 (250h5m27.665454637s) [upload=260335]: Uploading segments... Aug 19 03:31:05.706408022 (250h5m27.665505279s) [upload=260335]: Got next segment. Inline: true Aug 19 03:31:05.706418475 (250h5m27.66551573s) [upload=260335]: Waiting for error group managing segments... Aug 19 03:31:05.706488862 (250h5m27.665586112s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:31:05.706495919 (250h5m27.665593166s) [upload=260335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 03:31:05.706499814 (250h5m27.66559706s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 03:31:05.886133496 (250h5m27.845230741s) [upload=260335]: Done uploading segments... Aug 19 03:31:05.886151793 (250h5m27.845249026s) [upload=260335]: Upload finished. err: <nil> Duration:* 951.540084ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.X.........X.........X...................................X.] duration: 2.490734941s FAIL (2025-08-19 04:16:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.490829082s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 838.776301ms FAIL (2025-08-19 04:16:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a3b8a8af8256f812e06253e6d3ba448c6104f8101760b733051e91907fec0672 != before 426d0d60092cb4e5f1f8129568c2181d8de224f4ba9f5750cc98cf3b136c0060 ======LOGS====== Aug 19 03:31:05.706237698 (250h5m27.665334943s) [upload=260335]: Starting upload Aug 19 03:31:05.706288670 (250h5m27.665385916s) [upload=260335]: Done starting upload Aug 19 03:31:05.706357399 (250h5m27.665454637s) [upload=260335]: Uploading segments... Aug 19 03:31:05.706408022 (250h5m27.665505279s) [upload=260335]: Got next segment. Inline: true Aug 19 03:31:05.706418475 (250h5m27.66551573s) [upload=260335]: Waiting for error group managing segments... Aug 19 03:31:05.706488862 (250h5m27.665586112s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:31:05.706495919 (250h5m27.665593166s) [upload=260335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 03:31:05.706499814 (250h5m27.66559706s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 03:31:05.886133496 (250h5m27.845230741s) [upload=260335]: Done uploading segments... Aug 19 03:31:05.886151793 (250h5m27.845249026s) [upload=260335]: Upload finished. err: <nil> Duration:* 838.821447ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.X.........X.........X...................................X] duration: 2.362260038s FAIL (2025-08-19 04:16:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after fa4914e2847969892e27e02dee6fdcea59be5c7174718c21bc04cd9babcd9abe != before a49d81987b15ea4e182da9dcf127d0ae55229cd749ca0ce52413fefacecc0fdd ======LOGS====== Aug 19 04:16:08.231196950 (250h50m30.190294187s) [upload=261087]: Starting upload Aug 19 04:16:08.231284018 (250h50m30.190381271s) [upload=261087]: Done starting upload Aug 19 04:16:08.231463029 (250h50m30.190560281s) [upload=261087]: Uploading segments... Aug 19 04:16:08.231774542 (250h50m30.190871779s) [upload=261087]: Got next segment. Inline: false Aug 19 04:16:08.231861800 (250h50m30.190959046s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:16:08.231867666 (250h50m30.190964902s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:16:08.430864899 (250h50m30.389962159s) [seg_pos={0 0}, upload=261087]: Begin upload segment... Aug 19 04:16:08.430937547 (250h50m30.390034801s) [seg_pos={0 0}, upload=261087]: Done begin upload segment. Aug 19 04:16:08.430967518 (250h50m30.390064773s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.431600673 (250h50m30.390697922s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432033967 (250h50m30.391131216s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.432483534 (250h50m30.391580781s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433127276 (250h50m30.392224524s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.433603525 (250h50m30.392700773s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434139790 (250h50m30.393237055s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.434607613 (250h50m30.393704865s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.435496151 (250h50m30.394593408s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.436471162 (250h50m30.395568412s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.437998134 (250h50m30.397095393s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.438823947 (250h50m30.397921204s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439304913 (250h50m30.398402167s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.439713953 (250h50m30.39881121s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440095201 (250h50m30.399192458s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440504024 (250h50m30.399601269s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.440930155 (250h50m30.400027389s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.441443565 (250h50m30.400540819s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Uploading piece... Aug 19 04:16:08.975264000 (250h50m30.934361239s) [upload=261087]: Next returned nil segment Aug 19 04:16:08.975296005 (250h50m30.93439325s) [upload=261087]: Waiting for error group managing segments... Aug 19 04:16:09.146079477 (250h50m31.105176738s) [noise=true , address=45.91.116.11:4127 , piece_id=GAELWUVSSV2NQW24NPYLAV7AME5I4ZC3HNFPSLUMNDLEMY4Q7TJA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.158405029 (250h50m31.117502278s) [noise=true , address=77.90.31.13:4632 , piece_id=4EUGAN3G7HFGPOYWJ2HYGZK45WDBPBL75FA7ZZROCMIPGHQ6AXWQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.159435790 (250h50m31.11853304s) [noise=true , address=45.91.116.12:4239 , piece_id=SDTSDFFRYO5RTAHEZ4IBV57452M2YKVQYDPNUWDFXYTDM6DNGWQQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.162209651 (250h50m31.121306883s) [noise=true , address=77.90.31.15:4703 , piece_id=LW2A2KMAQ5JLLPJLPIUCMSKD3QOZMU6YUQKBWSK4SK5RXGV2YAIA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.168574741 (250h50m31.127671973s) [noise=true , address=77.90.31.11:4578 , piece_id=AFH6444DTDQVKADZXHMYG7MKF5AX7BWBG7IFZ7NQYY4OTC5MDHHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.170880413 (250h50m31.129977672s) [noise=true , address=104.36.82.18:4383 , piece_id=7NEJ7BLGLIWC5BPJJVMKTM7CGIVHPDZZ7GKXEFOT7QVRD7WUNBHA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.175117859 (250h50m31.13421513s) [noise=true , address=104.36.82.10:4090 , piece_id=FWV4WGJUPS6UVG7HDIQXFOE3QJFVNYK5JIGNPD5KC3OTVADG7AOA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.179351884 (250h50m31.13844914s) [noise=true , address=104.36.82.11:4141 , piece_id=VQMQ2BIRJ5TDRNXFRQJIDPEYCJMKRO5O3QY3EDOLHHLAV4QAYXEQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.189810057 (250h50m31.148907312s) [noise=true , address=77.90.31.12:4611 , piece_id=XDNHHIIGQN4Q7WTT335XVG4DGJEOJIKOYJ7C5P6S6UGCEKL7XALQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.200386836 (250h50m31.159484075s) [noise=true , address=104.36.82.5:4860 , piece_id=S4GDSPHM3HMXEPD4FPG2RYIDHRTKK25O4PP3KV5EC56X2SH4NFSA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.205691880 (250h50m31.16478913s) [noise=true , address=104.36.82.51:4073 , piece_id=ZYVLOSKJVA5Y7NGVUFZ2IFBUQRUG5NLE7JE4TRYYMR3LHBLTYRBQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.207268718 (250h50m31.166365968s) [noise=true , address=104.36.82.6:4908 , piece_id=I6CNDKFXEXQY4QRW3S6C6FHE5ONWAHT6BQXWHO4HANLSYBAJCGXA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.242056838 (250h50m31.201154084s) [noise=true , address=104.36.82.23:4460 , piece_id=K33CVT7SHKDXPED2H4CJN7BDRLUQHG2LBU2NQXRTPU5SKUCY5SEA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257515109 (250h50m31.216612356s) [noise=true , address=77.90.31.19:4872 , piece_id=D3XCL44IPBBENBF2ZYRI2GL26BZUXKAIXLNYYIIAW57JCHD3LWVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: <nil> Aug 19 04:16:09.257559624 (250h50m31.216656888s) [seg_pos={0 0}, upload=261087]: Segment reached optimal threshold of 14 pieces. Aug 19 04:16:09.257800241 (250h50m31.216897478s) [noise=true , address=79.127.201.215:4357 , piece_id=K3ZC554AC7BEPNNQ5UVGW4PGARSGQHA4W6WTX5KNEBUASKESVRWA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.257874254 (250h50m31.21697151s) [noise=true , address=77.90.31.17:4779 , piece_id=UFXV6HOARYYP2OHDKVLOZJAEEQKEPYRPHSPJOMTTMZLX37H2RDDA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258027754 (250h50m31.217125s) [noise=true , address=104.36.82.44:4870 , piece_id=YZFOKJY5IH7YZXH4VBQCQ3VJ37JNVV2PFN5U25ZNW72NRDOH34CA, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258071541 (250h50m31.217168776s) [noise=true , address=104.36.82.60:4347 , piece_id=XPOJIV4SLX54EDSCEHFGYYZCWJVTQ63Z5M7IN6WQPXDDZHF4CIVQ, seg_pos={0 0}, upload=261087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: expected piece hash; context canceled; EOF Aug 19 04:16:09.258091421 (250h50m31.217188666s) [seg_pos={0 0}, upload=261087]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 04:16:09.258188824 (250h50m31.21728607s) [upload=261087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 04:16:09.258216656 (250h50m31.217313905s) [upload=261087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:16:09.397592981 (250h50m31.356690216s) [upload=261087]: Done uploading segments... Aug 19 04:16:09.397616504 (250h50m31.356713739s) [upload=261087]: Upload finished. err: <nil> Duration: 2.362299615s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 857.653222ms FAIL (2025-08-19 04:15:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a3b8a8af8256f812e06253e6d3ba448c6104f8101760b733051e91907fec0672 != before 426d0d60092cb4e5f1f8129568c2181d8de224f4ba9f5750cc98cf3b136c0060 ======LOGS====== Aug 19 03:31:05.706237698 (250h5m27.665334943s) [upload=260335]: Starting upload Aug 19 03:31:05.706288670 (250h5m27.665385916s) [upload=260335]: Done starting upload Aug 19 03:31:05.706357399 (250h5m27.665454637s) [upload=260335]: Uploading segments... Aug 19 03:31:05.706408022 (250h5m27.665505279s) [upload=260335]: Got next segment. Inline: true Aug 19 03:31:05.706418475 (250h5m27.66551573s) [upload=260335]: Waiting for error group managing segments... Aug 19 03:31:05.706488862 (250h5m27.665586112s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:31:05.706495919 (250h5m27.665593166s) [upload=260335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 03:31:05.706499814 (250h5m27.66559706s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 03:31:05.886133496 (250h5m27.845230741s) [upload=260335]: Done uploading segments... Aug 19 03:31:05.886151793 (250h5m27.845249026s) [upload=260335]: Upload finished. err: <nil> Duration:* 857.704241ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.........X.........X...................................] duration: 2.641833713s FAIL (2025-08-19 04:15:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 03:46:50.024072899 (250h21m11.983170131s) [upload=260601]: Starting upload Aug 19 03:46:50.024149513 (250h21m11.983246759s) [upload=260601]: Done starting upload Aug 19 03:46:50.024413145 (250h21m11.983510391s) [upload=260601]: Uploading segments... Aug 19 03:46:50.024701666 (250h21m11.983798898s) [upload=260601]: Got next segment. Inline: false Aug 19 03:46:50.024789182 (250h21m11.983886436s) [upload=260601]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:46:50.024795426 (250h21m11.983892675s) [upload=260601]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 03:46:50.164207050 (250h21m12.123304304s) [upload=260601]: Next segment err: metaclient: Too Many Requests Aug 19 03:46:50.164227086 (250h21m12.123324335s) [upload=260601]: Done uploading segments... Aug 19 03:46:50.164253262 (250h21m12.123350507s) [upload=260601]: Upload finished. err: metaclient: Too Many Requests Duration: 2.641857756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 861.259445ms FAIL (2025-08-19 04:14:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a3b8a8af8256f812e06253e6d3ba448c6104f8101760b733051e91907fec0672 != before 426d0d60092cb4e5f1f8129568c2181d8de224f4ba9f5750cc98cf3b136c0060 ======LOGS====== Aug 19 03:31:05.706237698 (250h5m27.665334943s) [upload=260335]: Starting upload Aug 19 03:31:05.706288670 (250h5m27.665385916s) [upload=260335]: Done starting upload Aug 19 03:31:05.706357399 (250h5m27.665454637s) [upload=260335]: Uploading segments... Aug 19 03:31:05.706408022 (250h5m27.665505279s) [upload=260335]: Got next segment. Inline: true Aug 19 03:31:05.706418475 (250h5m27.66551573s) [upload=260335]: Waiting for error group managing segments... Aug 19 03:31:05.706488862 (250h5m27.665586112s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:31:05.706495919 (250h5m27.665593166s) [upload=260335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 03:31:05.706499814 (250h5m27.66559706s) [upload=260335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 03:31:05.886133496 (250h5m27.845230741s) [upload=260335]: Done uploading segments... Aug 19 03:31:05.886151793 (250h5m27.845249026s) [upload=260335]: Upload finished. err: <nil> Duration:* 861.352695ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.X.........X.........X..................................] duration: 2.508912036s FAIL (2025-08-19 04:14:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 03:46:50.024072899 (250h21m11.983170131s) [upload=260601]: Starting upload Aug 19 03:46:50.024149513 (250h21m11.983246759s) [upload=260601]: Done starting upload Aug 19 03:46:50.024413145 (250h21m11.983510391s) [upload=260601]: Uploading segments... Aug 19 03:46:50.024701666 (250h21m11.983798898s) [upload=260601]: Got next segment. Inline: false Aug 19 03:46:50.024789182 (250h21m11.983886436s) [upload=260601]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 03:46:50.024795426 (250h21m11.983892675s) [upload=260601]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 03:46:50.164207050 (250h21m12.123304304s) [upload=260601]: Next segment err: metaclient: Too Many Requests Aug 19 03:46:50.164227086 (250h21m12.123324335s) [upload=260601]: Done uploading segments... Aug 19 03:46:50.164253262 (250h21m12.123350507s) [upload=260601]: Upload finished. err: metaclient: Too Many Requests Duration: 2.508999964s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)