Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 22 out of 60 is failed (threshold=3) [XX..X.XX..................................X.XXXXXXXXXXXXXXXX] duration: 30.000489522s FAIL (2025-08-07 22:23:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000509472s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 106.838297ms remote: "tcp:185.244.226.2:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-07 22:23:34 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 106.86024ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXX.....................................XXXXXXXXXXXXXX] duration: 30.000995929s FAIL (2025-08-07 22:23:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001033906s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X...X..........................X....] duration: 843.913288ms FAIL (2025-08-07 22:23:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== oad=12946]: Done uploading segments... Aug 7 22:13:06.973788967 (12h33m28.717845817s) [upload=12946]: Upload finished. err: <nil> Aug 7 22:13:30.021513352 (12h33m51.765570214s) [upload=12952]: Starting upload Aug 7 22:13:30.021593609 (12h33m51.76565047s) [upload=12952]: Done starting upload Aug 7 22:13:30.021654614 (12h33m51.765711463s) [upload=12952]: Uploading segments... Aug 7 22:13:30.021737458 (12h33m51.765794327s) [upload=12952]: Got next segment. Inline: true Aug 7 22:13:30.021744385 (12h33m51.765801246s) [upload=12952]: Waiting for error group managing segments... Aug 7 22:13:30.021806243 (12h33m51.765863106s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:30.021811954 (12h33m51.765868813s) [upload=12952]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:30.021815203 (12h33m51.765872063s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:30.450767059 (12h33m52.194823912s) [upload=12952]: Done uploading segments... Aug 7 22:13:30.450786964 (12h33m52.194843815s) [upload=12952]: Upload finished. err: <nil> Aug 7 22:14:24.441642672 (12h34m46.185699519s) [upload=12964]: Starting upload Aug 7 22:14:24.441731987 (12h34m46.185788849s) [upload=12964]: Done starting upload Aug 7 22:14:24.441844223 (12h34m46.185901069s) [upload=12964]: Uploading segments... Aug 7 22:14:24.441952356 (12h34m46.186009238s) [upload=12964]: Got next segment. Inline: true Aug 7 22:14:24.441960404 (12h34m46.186017265s) [upload=12964]: Waiting for error group managing segments... Aug 7 22:14:24.442032277 (12h34m46.186089141s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:24.442038920 (12h34m46.186095769s) [upload=12964]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:24.442045324 (12h34m46.186102193s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:24.691130502 (12h34m46.435187353s) [upload=12964]: Done uploading segments... Aug 7 22:14:24.691168009 (12h34m46.435224859s) [upload=12964]: Upload finished. err: <nil> Aug 7 22:14:52.288782940 (12h35m14.032839801s) [upload=12974]: Starting upload Aug 7 22:14:52.288924660 (12h35m14.032981562s) [upload=12974]: Done starting upload Aug 7 22:14:52.288991726 (12h35m14.033048572s) [upload=12974]: Uploading segments... Aug 7 22:14:52.289071270 (12h35m14.033128145s) [upload=12974]: Got next segment. Inline: true Aug 7 22:14:52.289078867 (12h35m14.033135735s) [upload=12974]: Waiting for error group managing segments... Aug 7 22:14:52.289164039 (12h35m14.0332209s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:52.289171651 (12h35m14.033228513s) [upload=12974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:52.289176583 (12h35m14.033233444s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:52.452595224 (12h35m14.196652085s) [upload=12974]: Done uploading segments... Aug 7 22:14:52.452614952 (12h35m14.196671802s) [upload=12974]: Upload finished. err: <nil> Aug 7 22:15:58.755852650 (12h36m20.499909522s) [upload=12993]: Starting upload Aug 7 22:15:58.755930601 (12h36m20.499987455s) [upload=12993]: Done starting upload Aug 7 22:15:58.756035921 (12h36m20.500092782s) [upload=12993]: Uploading segments... Aug 7 22:15:58.756122656 (12h36m20.500179529s) [upload=12993]: Got next segment. Inline: true Aug 7 22:15:58.756129927 (12h36m20.500186799s) [upload=12993]: Waiting for error group managing segments... Aug 7 22:15:58.756200897 (12h36m20.500257762s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:58.756207605 (12h36m20.500264472s) [upload=12993]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:58.756211651 (12h36m20.500268513s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:58.903437708 (12h36m20.647494557s) [upload=12993]: Done uploading segments... Aug 7 22:15:58.903462384 (12h36m20.647519231s) [upload=12993]: Upload finished. err: <nil> Aug 7 22:16:15.337485833 (12h36m37.081542697s) [upload=12998]: Starting upload Aug 7 22:16:15.337573316 (12h36m37.081630164s) [upload=12998]: Done starting upload Aug 7 22:16:15.337667907 (12h36m37.081724797s) [upload=12998]: Uploading segments... Aug 7 22:16:15.337814382 (12h36m37.081871252s) [upload=12998]: Got next segment. Inline: true Aug 7 22:16:15.337826053 (12h36m37.081882921s) [upload=12998]: Waiting for error group managing segments... Aug 7 22:16:15.337898669 (12h36m37.08195553s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.337905734 (12h36m37.081962605s) [upload=12998]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.337934067 (12h36m37.081990931s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.509139020 (12h36m37.253195886s) [upload=12998]: Done uploading segments... Aug 7 22:16:15.509165009 (12h36m37.253221873s) [upload=12998]: Upload finished. err: <nil> Aug 7 22:16:46.696796765 (12h37m8.440853615s) [upload=13006]: Starting upload Aug 7 22:16:46.696851500 (12h37m8.440908351s) [upload=13006]: Done starting upload Aug 7 22:16:46.696919178 (12h37m8.44097604s) [upload=13006]: Uploading segments... Aug 7 22:16:46.696965400 (12h37m8.441022269s) [upload=13006]: Got next segment. Inline: true Aug 7 22:16:46.696970111 (12h37m8.441026962s) [upload=13006]: Waiting for error group managing segments... Aug 7 22:16:46.697010995 (12h37m8.441067847s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:46.697016018 (12h37m8.441072868s) [upload=13006]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:46.697019675 (12h37m8.44107653s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:46.874265238 (12h37m8.618322106s) [upload=13006]: Done uploading segments... Aug 7 22:16:46.874318422 (12h37m8.618375284s) [upload=13006]: Upload finished. err: <nil> Aug 7 22:17:54.674081400 (12h38m16.418138249s) [upload=13021]: Starting upload Aug 7 22:17:54.674159403 (12h38m16.418216253s) [upload=13021]: Done starting upload Aug 7 22:17:54.674269670 (12h38m16.418326517s) [upload=13021]: Uploading segments... Aug 7 22:17:54.674363154 (12h38m16.418420014s) [upload=13021]: Got next segment. Inline: true Aug 7 22:17:54.674369843 (12h38m16.418426703s) [upload=13021]: Waiting for error group managing segments... Aug 7 22:17:54.674442390 (12h38m16.418499251s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:54.674447948 (12h38m16.418504799s) [upload=13021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:54.674451453 (12h38m16.418508313s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:54.827409307 (12h38m16.571466155s) [upload=13021]: Done uploading segments... Aug 7 22:17:54.827433528 (12h38m16.571490374s) [upload=13021]: Upload finished. err: <nil> Aug 7 22:19:01.440458592 (12h39m23.184515453s) [upload=13036]: Starting upload Aug 7 22:19:01.440570182 (12h39m23.184627051s) [upload=13036]: Done starting upload Aug 7 22:19:01.440699423 (12h39m23.184756285s) [upload=13036]: Uploading segments... Aug 7 22:19:01.440794556 (12h39m23.184851411s) [upload=13036]: Got next segment. Inline: true Aug 7 22:19:01.440803141 (12h39m23.184860002s) [upload=13036]: Waiting for error group managing segments... Aug 7 22:19:01.440879672 (12h39m23.184936519s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:01.440886345 (12h39m23.184943191s) [upload=13036]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:01.440890294 (12h39m23.184947158s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:01.709467042 (12h39m23.45352391s) [upload=13036]: Done uploading segments... Aug 7 22:19:01.709491674 (12h39m23.453548536s) [upload=13036]: Upload finished. err: <nil> Aug 7 22:19:45.253186247 (12h40m6.997243094s) [upload=13047]: Starting upload Aug 7 22:19:45.253237927 (12h40m6.997294773s) [upload=13047]: Done starting upload Aug 7 22:19:45.253295065 (12h40m6.997351912s) [upload=13047]: Uploading segments... Aug 7 22:19:45.253376256 (12h40m6.997433124s) [upload=13047]: Got next segment. Inline: true Aug 7 22:19:45.253382535 (12h40m6.997439396s) [upload=13047]: Waiting for error group managing segments... Aug 7 22:19:45.253441431 (12h40m6.997498291s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:45.253446448 (12h40m6.997503294s) [upload=13047]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:45.253449347 (12h40m6.997506208s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:45.480979982 (12h40m7.225036832s) [upload=13047]: Done uploading segments... Aug 7 22:19:45.480999304 (12h40m7.22505615s) [upload=13047]: Upload finished. err: <nil> Aug 7 22:20:54.671307886 (12h41m16.415364754s) [upload=13061]: Starting upload Aug 7 22:20:54.671398239 (12h41m16.41545511s) [upload=13061]: Done starting upload Aug 7 22:20:54.671491892 (12h41m16.415548958s) [upload=13061]: Uploading segments... Aug 7 22:20:54.671578785 (12h41m16.415635652s) [upload=13061]: Got next segment. Inline: true Aug 7 22:20:54.671585361 (12h41m16.415642224s) [upload=13061]: Waiting for error group managing segments... Aug 7 22:20:54.671656504 (12h41m16.415713357s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:54.671670437 (12h41m16.415727303s) [upload=13061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:54.671692679 (12h41m16.415749544s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:54.840367361 (12h41m16.584424221s) [upload=13061]: Done uploading segments... Aug 7 22:20:54.840387040 (12h41m16.5844439s) [upload=13061]: Upload finished. err: <nil> Duration: 843.943758ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXX....X...................................XXXXXXXXXX] duration: 30.00086981s FAIL (2025-08-07 22:23:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 32s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859636824 (12h38m57.603693684s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859812093 (12h38m57.603868953s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859925097 (12h38m57.603981964s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860231094 (12h38m57.604287959s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860523549 (12h38m57.604580412s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860874877 (12h38m57.604931741s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861016178 (12h38m57.605073041s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861300910 (12h38m57.605357771s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861542714 (12h38m57.605599577s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861779246 (12h38m57.605836106s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862035981 (12h38m57.606092841s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862356106 (12h38m57.606412969s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862436053 (12h38m57.606492918s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:36.505852265 (12h38m58.249909134s) [upload=13028]: Next returned nil segment Aug 7 22:18:36.505904890 (12h38m58.249961752s) [upload=13028]: Waiting for error group managing segments... Aug 7 22:18:36.661898608 (12h38m58.405955463s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.662658349 (12h38m58.4067152s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.672427817 (12h38m58.416484668s) [noise=true , address=104.36.82.13:4186 , piece_id=DJV6WV6OIEMPDG375GOL3KEMUI6WPM74X2HGTWPIMTEQ4TVPNY3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.673195384 (12h38m58.417252236s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.688191302 (12h38m58.432248156s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.748647081 (12h38m58.492703931s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.754316603 (12h38m58.498373455s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.757866924 (12h38m58.501923802s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.795631640 (12h38m58.539688508s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.802345397 (12h38m58.546402257s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.943130940 (12h38m58.687187793s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.569043987 (12h38m59.313100835s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628087539 (12h38m59.372144385s) [noise=true , address=104.36.82.16:4294 , piece_id=THYXT4PVF3YCWWRFQ26F7UV5VATM2YCUMKUQPVFMEDXB5V43LDAQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628112588 (12h38m59.372169448s) [seg_pos={0 0}, upload=13028]: Segment reached optimal threshold of 13 pieces. Aug 7 22:18:37.628331778 (12h38m59.372388642s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Aug 7 22:18:37.628789234 (12h38m59.372846099s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection Aug 7 22:18:37.628909632 (12h38m59.372966496s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection Aug 7 22:18:37.628933550 (12h38m59.37299042s) [seg_pos={0 0}, upload=13028]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 22:18:37.629080212 (12h38m59.37313708s) [upload=13028]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:18:37.629088669 (12h38m59.373145541s) [upload=13028]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:31.034302254 (12h42m52.778359114s) [upload=13028]: Done uploading segments... Aug 7 22:22:31.034330509 (12h42m52.77838737s) [upload=13028]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:22:31.496201038 (12h42m53.240257897s) [upload=13082]: Starting upload Aug 7 22:22:31.496288429 (12h42m53.24034529s) [upload=13082]: Done starting upload Aug 7 22:22:31.496419106 (12h42m53.240475958s) [upload=13082]: Uploading segments... Aug 7 22:22:31.496560071 (12h42m53.240616919s) [upload=13082]: Got next segment. Inline: false Aug 7 22:22:31.496599327 (12h42m53.240656175s) [upload=13082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:22:31.496604367 (12h42m53.240661227s) [upload=13082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:23:01.218010293 (12h43m22.962067243s) [upload=13082]: Next segment err: context deadline exceeded Aug 7 22:23:01.218145129 (12h43m22.962201978s) [upload=13082]: Done uploading segments... Aug 7 22:23:01.218179309 (12h43m22.962236162s) [upload=13082]: Upload finished. err: context deadline exceeded Aug 7 22:23:01.633144581 (12h43m23.377201441s) [upload=13089]: Starting upload Aug 7 22:23:01.633314041 (12h43m23.377370908s) [upload=13089]: Done starting upload Aug 7 22:23:01.633463341 (12h43m23.377520205s) [upload=13089]: Uploading segments... Aug 7 22:23:01.633690345 (12h43m23.377747209s) [upload=13089]: Got next segment. Inline: false Aug 7 22:23:01.633751249 (12h43m23.377808124s) [upload=13089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:23:01.633761188 (12h43m23.377818063s) [upload=13089]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:23:31.362766442 (12h43m53.106823308s) [upload=13089]: Next segment err: context deadline exceeded Aug 7 22:23:31.362914175 (12h43m53.10697104s) [upload=13089]: Done uploading segments... Aug 7 22:23:31.362942273 (12h43m53.106999122s) [upload=13089]: Upload finished. err: context deadline exceeded Duration: 30.000893608s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [....XX.X................................................XXX.] duration: 312.289928ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 22:23:21 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 312.310769ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXX....................................XXXXXXXXXXXX.X] duration: 30.000680135s FAIL (2025-08-07 22:23:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== oad Aug 7 22:14:59.902751694 (12h35m21.646808545s) [upload=12977]: Uploading segments... Aug 7 22:14:59.902795346 (12h35m21.646852214s) [upload=12977]: Got next segment. Inline: true Aug 7 22:14:59.902801495 (12h35m21.646858346s) [upload=12977]: Waiting for error group managing segments... Aug 7 22:14:59.902858709 (12h35m21.64691556s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:59.902863962 (12h35m21.646920811s) [upload=12977]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:59.902867458 (12h35m21.646924309s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:29.636302762 (12h35m51.380359612s) [upload=12977]: Done uploading segments... Aug 7 22:15:29.636325398 (12h35m51.380382249s) [upload=12977]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:45.428850713 (12h36m7.172907563s) [upload=12988]: Starting upload Aug 7 22:15:45.428978829 (12h36m7.173035696s) [upload=12988]: Done starting upload Aug 7 22:15:45.429103446 (12h36m7.173160298s) [upload=12988]: Uploading segments... Aug 7 22:15:45.429150754 (12h36m7.173207623s) [upload=12988]: Got next segment. Inline: true Aug 7 22:15:45.429156339 (12h36m7.173213199s) [upload=12988]: Waiting for error group managing segments... Aug 7 22:15:45.429230361 (12h36m7.173287221s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:45.429247463 (12h36m7.173304325s) [upload=12988]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:45.429251133 (12h36m7.173307993s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.155440875 (12h36m36.899497725s) [upload=12988]: Done uploading segments... Aug 7 22:16:15.155471506 (12h36m36.899528367s) [upload=12988]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:15.598565945 (12h36m37.342622791s) [upload=12999]: Starting upload Aug 7 22:16:15.598645050 (12h36m37.342701913s) [upload=12999]: Done starting upload Aug 7 22:16:15.598718650 (12h36m37.342775497s) [upload=12999]: Uploading segments... Aug 7 22:16:15.598774264 (12h36m37.34283113s) [upload=12999]: Got next segment. Inline: true Aug 7 22:16:15.598779124 (12h36m37.342835984s) [upload=12999]: Waiting for error group managing segments... Aug 7 22:16:15.598830461 (12h36m37.342887324s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.598854102 (12h36m37.342910963s) [upload=12999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.598857833 (12h36m37.342914694s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:45.328584439 (12h37m7.072641289s) [upload=12999]: Done uploading segments... Aug 7 22:16:45.328609005 (12h37m7.072665856s) [upload=12999]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:27.480756310 (12h37m49.22481316s) [upload=13015]: Starting upload Aug 7 22:17:27.480859326 (12h37m49.22491619s) [upload=13015]: Done starting upload Aug 7 22:17:27.480944450 (12h37m49.225001301s) [upload=13015]: Uploading segments... Aug 7 22:17:27.481000891 (12h37m49.225057757s) [upload=13015]: Got next segment. Inline: true Aug 7 22:17:27.481006468 (12h37m49.225063328s) [upload=13015]: Waiting for error group managing segments... Aug 7 22:17:27.481069727 (12h37m49.225126586s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:27.481076622 (12h37m49.225133484s) [upload=13015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:27.481081288 (12h37m49.225138155s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:57.211870572 (12h38m18.955927423s) [upload=13015]: Done uploading segments... Aug 7 22:17:57.211892595 (12h38m18.955949444s) [upload=13015]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:14.331617780 (12h38m36.07567463s) [upload=13026]: Starting upload Aug 7 22:18:14.331690520 (12h38m36.07574737s) [upload=13026]: Done starting upload Aug 7 22:18:14.331789874 (12h38m36.075846724s) [upload=13026]: Uploading segments... Aug 7 22:18:14.331829497 (12h38m36.075886363s) [upload=13026]: Got next segment. Inline: true Aug 7 22:18:14.331834588 (12h38m36.075891448s) [upload=13026]: Waiting for error group managing segments... Aug 7 22:18:14.331890028 (12h38m36.075946878s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:14.331895594 (12h38m36.075952444s) [upload=13026]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:14.331899378 (12h38m36.075956238s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:44.050649404 (12h39m5.794706254s) [upload=13026]: Done uploading segments... Aug 7 22:18:44.050671176 (12h39m5.794728026s) [upload=13026]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:08.682705115 (12h39m30.42676198s) [upload=13039]: Starting upload Aug 7 22:19:08.682797967 (12h39m30.426854836s) [upload=13039]: Done starting upload Aug 7 22:19:08.682924116 (12h39m30.426980968s) [upload=13039]: Uploading segments... Aug 7 22:19:08.682986486 (12h39m30.427043358s) [upload=13039]: Got next segment. Inline: true Aug 7 22:19:08.682993964 (12h39m30.427050856s) [upload=13039]: Waiting for error group managing segments... Aug 7 22:19:08.683054026 (12h39m30.427110894s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:08.683060373 (12h39m30.427117244s) [upload=13039]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:08.683064440 (12h39m30.42712131s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:38.406368834 (12h40m0.150425697s) [upload=13039]: Done uploading segments... Aug 7 22:19:38.406426692 (12h40m0.150483554s) [upload=13039]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:20.517418397 (12h40m42.26147525s) [upload=13053]: Starting upload Aug 7 22:20:20.517575991 (12h40m42.261632856s) [upload=13053]: Done starting upload Aug 7 22:20:20.517715190 (12h40m42.261772059s) [upload=13053]: Uploading segments... Aug 7 22:20:20.517901368 (12h40m42.26195823s) [upload=13053]: Got next segment. Inline: true Aug 7 22:20:20.517963476 (12h40m42.262020457s) [upload=13053]: Waiting for error group managing segments... Aug 7 22:20:20.518079988 (12h40m42.262137053s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:20.518123882 (12h40m42.262180743s) [upload=13053]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:20.518130819 (12h40m42.262187685s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:50.250392650 (12h41m11.994449511s) [upload=13053]: Done uploading segments... Aug 7 22:20:50.250418123 (12h41m11.994474984s) [upload=13053]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:21:32.413463521 (12h41m54.157520381s) [upload=13069]: Starting upload Aug 7 22:21:32.413532657 (12h41m54.157589509s) [upload=13069]: Done starting upload Aug 7 22:21:32.413608430 (12h41m54.157665281s) [upload=13069]: Uploading segments... Aug 7 22:21:32.413661653 (12h41m54.157718517s) [upload=13069]: Got next segment. Inline: true Aug 7 22:21:32.413666698 (12h41m54.157723558s) [upload=13069]: Waiting for error group managing segments... Aug 7 22:21:32.413708373 (12h41m54.157765222s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:21:32.413713536 (12h41m54.157770396s) [upload=13069]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:21:32.413727266 (12h41m54.157784127s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:02.144247861 (12h42m23.888304727s) [upload=13069]: Done uploading segments... Aug 7 22:22:02.144276519 (12h42m23.888333383s) [upload=13069]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:22:03.530038115 (12h42m25.274094985s) [upload=13077]: Starting upload Aug 7 22:22:03.530157956 (12h42m25.27421483s) [upload=13077]: Done starting upload Aug 7 22:22:03.530254340 (12h42m25.274311199s) [upload=13077]: Uploading segments... Aug 7 22:22:03.530319521 (12h42m25.274376398s) [upload=13077]: Got next segment. Inline: true Aug 7 22:22:03.530326839 (12h42m25.27438371s) [upload=13077]: Waiting for error group managing segments... Aug 7 22:22:03.530387033 (12h42m25.274443903s) [upload=13077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:22:03.530393764 (12h42m25.274450635s) [upload=13077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:22:03.530398068 (12h42m25.274454934s) [upload=13077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:03.668101987 (12h42m25.412158856s) [upload=13077]: Done uploading segments... Aug 7 22:22:03.668146181 (12h42m25.412203031s) [upload=13077]: Upload finished. err: <nil> Aug 7 22:22:50.781175997 (12h43m12.525232844s) [upload=13085]: Starting upload Aug 7 22:22:50.781238492 (12h43m12.525295338s) [upload=13085]: Done starting upload Aug 7 22:22:50.781295832 (12h43m12.525352678s) [upload=13085]: Uploading segments... Aug 7 22:22:50.781339974 (12h43m12.525396844s) [upload=13085]: Got next segment. Inline: true Aug 7 22:22:50.781344619 (12h43m12.525401479s) [upload=13085]: Waiting for error group managing segments... Aug 7 22:22:50.781382529 (12h43m12.525439375s) [upload=13085]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:22:50.781387267 (12h43m12.525444113s) [upload=13085]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:22:50.781389841 (12h43m12.525446704s) [upload=13085]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:23:20.513298723 (12h43m42.257355587s) [upload=13085]: Done uploading segments... Aug 7 22:23:20.513325654 (12h43m42.25738252s) [upload=13085]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.000707227s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.....XX.X................................................XXX] duration: 2m0.001117008s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 22:23:20 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.001133547s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.....X.........X..X...........X......................] duration: 3.54590663s FAIL (2025-08-07 22:23:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 5.727759364s) [upload=12820]: Starting upload Aug 7 22:05:23.983754833 (12h25m45.727811679s) [upload=12820]: Done starting upload Aug 7 22:05:23.983988533 (12h25m45.728045379s) [upload=12820]: Uploading segments... Aug 7 22:05:23.984022348 (12h25m45.728079214s) [upload=12820]: Got next segment. Inline: false Aug 7 22:05:23.984055700 (12h25m45.728112548s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:05:23.984060538 (12h25m45.728117398s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:05:24.185392691 (12h25m45.929449561s) [seg_pos={0 0}, upload=12820]: Begin upload segment... Aug 7 22:05:24.185557956 (12h25m45.929614817s) [seg_pos={0 0}, upload=12820]: Done begin upload segment. Aug 7 22:05:24.185603301 (12h25m45.929660177s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186037040 (12h25m45.930093906s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186570414 (12h25m45.930627287s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186824559 (12h25m45.930881425s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187208122 (12h25m45.931264991s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187658761 (12h25m45.931715627s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187940002 (12h25m45.931996872s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188116203 (12h25m45.932173069s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188531115 (12h25m45.932587976s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188637273 (12h25m45.932694145s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188961006 (12h25m45.933017872s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189183712 (12h25m45.933240578s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189352560 (12h25m45.933409422s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189640677 (12h25m45.93369755s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189855650 (12h25m45.933912517s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190187162 (12h25m45.934244033s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190334028 (12h25m45.934390898s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190661949 (12h25m45.934718816s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.754845434 (12h25m46.498902284s) [upload=12820]: Next returned nil segment Aug 7 22:05:24.754862619 (12h25m46.49891948s) [upload=12820]: Waiting for error group managing segments... Aug 7 22:05:24.937656798 (12h25m46.681713649s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.980443483 (12h25m46.724500333s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.995491860 (12h25m46.739551452s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.083772095 (12h25m46.827828964s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.147179204 (12h25m46.891236066s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.274393636 (12h25m47.018450492s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.452784464 (12h25m47.196841314s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.474459740 (12h25m47.218516586s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.481247102 (12h25m47.225303949s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666066275 (12h25m47.410123138s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666429351 (12h25m47.410486202s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.782101005 (12h25m47.526157853s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.863469768 (12h25m47.607526622s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865162168 (12h25m47.609219032s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865201343 (12h25m47.609258205s) [seg_pos={0 0}, upload=12820]: Segment reached optimal threshold of 14 pieces. Aug 7 22:05:25.865362755 (12h25m47.609419601s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865412734 (12h25m47.609469599s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nhwT2THUu6ptumqU9Bz1Nd34FHLewx9vWjGFC34j3Lz3RWfkw): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865468394 (12h25m47.609525241s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sUT7LBYFqWMUhx7MMjEmyiFDnbJnjSVndNbTaHioaVLLSXYue): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865629517 (12h25m47.609686385s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1akHUSoQFafzkGTJ385iYaowc87pJBDNfU5hodSCUDFa5ojN3v): protocol: write tcp 139.59.144.22:45386->104.36.82.22:4530: use of closed network connection; context canceled Aug 7 22:05:25.865657252 (12h25m47.609714121s) [seg_pos={0 0}, upload=12820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:05:25.865814825 (12h25m47.609871688s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:05:25.865822925 (12h25m47.609879795s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:05:26.138690358 (12h25m47.882747231s) [upload=12820]: Done uploading segments... Aug 7 22:05:26.138713087 (12h25m47.882769948s) [upload=12820]: Upload finished. err: <nil> Duration: 3.545940059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...X..........................X...] duration: 848.960052ms FAIL (2025-08-07 22:23:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== oad=12946]: Done uploading segments... Aug 7 22:13:06.973788967 (12h33m28.717845817s) [upload=12946]: Upload finished. err: <nil> Aug 7 22:13:30.021513352 (12h33m51.765570214s) [upload=12952]: Starting upload Aug 7 22:13:30.021593609 (12h33m51.76565047s) [upload=12952]: Done starting upload Aug 7 22:13:30.021654614 (12h33m51.765711463s) [upload=12952]: Uploading segments... Aug 7 22:13:30.021737458 (12h33m51.765794327s) [upload=12952]: Got next segment. Inline: true Aug 7 22:13:30.021744385 (12h33m51.765801246s) [upload=12952]: Waiting for error group managing segments... Aug 7 22:13:30.021806243 (12h33m51.765863106s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:30.021811954 (12h33m51.765868813s) [upload=12952]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:30.021815203 (12h33m51.765872063s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:30.450767059 (12h33m52.194823912s) [upload=12952]: Done uploading segments... Aug 7 22:13:30.450786964 (12h33m52.194843815s) [upload=12952]: Upload finished. err: <nil> Aug 7 22:14:24.441642672 (12h34m46.185699519s) [upload=12964]: Starting upload Aug 7 22:14:24.441731987 (12h34m46.185788849s) [upload=12964]: Done starting upload Aug 7 22:14:24.441844223 (12h34m46.185901069s) [upload=12964]: Uploading segments... Aug 7 22:14:24.441952356 (12h34m46.186009238s) [upload=12964]: Got next segment. Inline: true Aug 7 22:14:24.441960404 (12h34m46.186017265s) [upload=12964]: Waiting for error group managing segments... Aug 7 22:14:24.442032277 (12h34m46.186089141s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:24.442038920 (12h34m46.186095769s) [upload=12964]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:24.442045324 (12h34m46.186102193s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:24.691130502 (12h34m46.435187353s) [upload=12964]: Done uploading segments... Aug 7 22:14:24.691168009 (12h34m46.435224859s) [upload=12964]: Upload finished. err: <nil> Aug 7 22:14:52.288782940 (12h35m14.032839801s) [upload=12974]: Starting upload Aug 7 22:14:52.288924660 (12h35m14.032981562s) [upload=12974]: Done starting upload Aug 7 22:14:52.288991726 (12h35m14.033048572s) [upload=12974]: Uploading segments... Aug 7 22:14:52.289071270 (12h35m14.033128145s) [upload=12974]: Got next segment. Inline: true Aug 7 22:14:52.289078867 (12h35m14.033135735s) [upload=12974]: Waiting for error group managing segments... Aug 7 22:14:52.289164039 (12h35m14.0332209s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:52.289171651 (12h35m14.033228513s) [upload=12974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:52.289176583 (12h35m14.033233444s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:52.452595224 (12h35m14.196652085s) [upload=12974]: Done uploading segments... Aug 7 22:14:52.452614952 (12h35m14.196671802s) [upload=12974]: Upload finished. err: <nil> Aug 7 22:15:58.755852650 (12h36m20.499909522s) [upload=12993]: Starting upload Aug 7 22:15:58.755930601 (12h36m20.499987455s) [upload=12993]: Done starting upload Aug 7 22:15:58.756035921 (12h36m20.500092782s) [upload=12993]: Uploading segments... Aug 7 22:15:58.756122656 (12h36m20.500179529s) [upload=12993]: Got next segment. Inline: true Aug 7 22:15:58.756129927 (12h36m20.500186799s) [upload=12993]: Waiting for error group managing segments... Aug 7 22:15:58.756200897 (12h36m20.500257762s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:58.756207605 (12h36m20.500264472s) [upload=12993]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:58.756211651 (12h36m20.500268513s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:58.903437708 (12h36m20.647494557s) [upload=12993]: Done uploading segments... Aug 7 22:15:58.903462384 (12h36m20.647519231s) [upload=12993]: Upload finished. err: <nil> Aug 7 22:16:15.337485833 (12h36m37.081542697s) [upload=12998]: Starting upload Aug 7 22:16:15.337573316 (12h36m37.081630164s) [upload=12998]: Done starting upload Aug 7 22:16:15.337667907 (12h36m37.081724797s) [upload=12998]: Uploading segments... Aug 7 22:16:15.337814382 (12h36m37.081871252s) [upload=12998]: Got next segment. Inline: true Aug 7 22:16:15.337826053 (12h36m37.081882921s) [upload=12998]: Waiting for error group managing segments... Aug 7 22:16:15.337898669 (12h36m37.08195553s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.337905734 (12h36m37.081962605s) [upload=12998]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.337934067 (12h36m37.081990931s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.509139020 (12h36m37.253195886s) [upload=12998]: Done uploading segments... Aug 7 22:16:15.509165009 (12h36m37.253221873s) [upload=12998]: Upload finished. err: <nil> Aug 7 22:16:46.696796765 (12h37m8.440853615s) [upload=13006]: Starting upload Aug 7 22:16:46.696851500 (12h37m8.440908351s) [upload=13006]: Done starting upload Aug 7 22:16:46.696919178 (12h37m8.44097604s) [upload=13006]: Uploading segments... Aug 7 22:16:46.696965400 (12h37m8.441022269s) [upload=13006]: Got next segment. Inline: true Aug 7 22:16:46.696970111 (12h37m8.441026962s) [upload=13006]: Waiting for error group managing segments... Aug 7 22:16:46.697010995 (12h37m8.441067847s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:46.697016018 (12h37m8.441072868s) [upload=13006]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:46.697019675 (12h37m8.44107653s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:46.874265238 (12h37m8.618322106s) [upload=13006]: Done uploading segments... Aug 7 22:16:46.874318422 (12h37m8.618375284s) [upload=13006]: Upload finished. err: <nil> Aug 7 22:17:54.674081400 (12h38m16.418138249s) [upload=13021]: Starting upload Aug 7 22:17:54.674159403 (12h38m16.418216253s) [upload=13021]: Done starting upload Aug 7 22:17:54.674269670 (12h38m16.418326517s) [upload=13021]: Uploading segments... Aug 7 22:17:54.674363154 (12h38m16.418420014s) [upload=13021]: Got next segment. Inline: true Aug 7 22:17:54.674369843 (12h38m16.418426703s) [upload=13021]: Waiting for error group managing segments... Aug 7 22:17:54.674442390 (12h38m16.418499251s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:54.674447948 (12h38m16.418504799s) [upload=13021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:54.674451453 (12h38m16.418508313s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:54.827409307 (12h38m16.571466155s) [upload=13021]: Done uploading segments... Aug 7 22:17:54.827433528 (12h38m16.571490374s) [upload=13021]: Upload finished. err: <nil> Aug 7 22:19:01.440458592 (12h39m23.184515453s) [upload=13036]: Starting upload Aug 7 22:19:01.440570182 (12h39m23.184627051s) [upload=13036]: Done starting upload Aug 7 22:19:01.440699423 (12h39m23.184756285s) [upload=13036]: Uploading segments... Aug 7 22:19:01.440794556 (12h39m23.184851411s) [upload=13036]: Got next segment. Inline: true Aug 7 22:19:01.440803141 (12h39m23.184860002s) [upload=13036]: Waiting for error group managing segments... Aug 7 22:19:01.440879672 (12h39m23.184936519s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:01.440886345 (12h39m23.184943191s) [upload=13036]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:01.440890294 (12h39m23.184947158s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:01.709467042 (12h39m23.45352391s) [upload=13036]: Done uploading segments... Aug 7 22:19:01.709491674 (12h39m23.453548536s) [upload=13036]: Upload finished. err: <nil> Aug 7 22:19:45.253186247 (12h40m6.997243094s) [upload=13047]: Starting upload Aug 7 22:19:45.253237927 (12h40m6.997294773s) [upload=13047]: Done starting upload Aug 7 22:19:45.253295065 (12h40m6.997351912s) [upload=13047]: Uploading segments... Aug 7 22:19:45.253376256 (12h40m6.997433124s) [upload=13047]: Got next segment. Inline: true Aug 7 22:19:45.253382535 (12h40m6.997439396s) [upload=13047]: Waiting for error group managing segments... Aug 7 22:19:45.253441431 (12h40m6.997498291s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:45.253446448 (12h40m6.997503294s) [upload=13047]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:45.253449347 (12h40m6.997506208s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:45.480979982 (12h40m7.225036832s) [upload=13047]: Done uploading segments... Aug 7 22:19:45.480999304 (12h40m7.22505615s) [upload=13047]: Upload finished. err: <nil> Aug 7 22:20:54.671307886 (12h41m16.415364754s) [upload=13061]: Starting upload Aug 7 22:20:54.671398239 (12h41m16.41545511s) [upload=13061]: Done starting upload Aug 7 22:20:54.671491892 (12h41m16.415548958s) [upload=13061]: Uploading segments... Aug 7 22:20:54.671578785 (12h41m16.415635652s) [upload=13061]: Got next segment. Inline: true Aug 7 22:20:54.671585361 (12h41m16.415642224s) [upload=13061]: Waiting for error group managing segments... Aug 7 22:20:54.671656504 (12h41m16.415713357s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:54.671670437 (12h41m16.415727303s) [upload=13061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:54.671692679 (12h41m16.415749544s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:54.840367361 (12h41m16.584424221s) [upload=13061]: Done uploading segments... Aug 7 22:20:54.840387040 (12h41m16.5844439s) [upload=13061]: Upload finished. err: <nil> Duration: 849.002393ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 22 out of 60 is failed (threshold=3) [XXX..X.XX..................................X.XXXXXXXXXXXXXXX] duration: 30.000946241s FAIL (2025-08-07 22:23:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.00097225s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXX....X...................................XXXXXXXXX] duration: 30.000857669s FAIL (2025-08-07 22:23:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 7 22:18:20.485638921 (12h38m42.229695786s) [upload=13028]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:20.485645374 (12h38m42.229702242s) [upload=13028]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:18:35.859004202 (12h38m57.603061071s) [seg_pos={0 0}, upload=13028]: Begin upload segment... Aug 7 22:18:35.859066970 (12h38m57.603123828s) [seg_pos={0 0}, upload=13028]: Done begin upload segment. Aug 7 22:18:35.859099123 (12h38m57.603155989s) [noise=true , address=104.36.82.13:4186 , piece_id=DJV6WV6OIEMPDG375GOL3KEMUI6WPM74X2HGTWPIMTEQ4TVPNY3Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859111400 (12h38m57.603168271s) [noise=true , address=104.36.82.16:4294 , piece_id=THYXT4PVF3YCWWRFQ26F7UV5VATM2YCUMKUQPVFMEDXB5V43LDAQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859573268 (12h38m57.603630132s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859636824 (12h38m57.603693684s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859812093 (12h38m57.603868953s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859925097 (12h38m57.603981964s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860231094 (12h38m57.604287959s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860523549 (12h38m57.604580412s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860874877 (12h38m57.604931741s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861016178 (12h38m57.605073041s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861300910 (12h38m57.605357771s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861542714 (12h38m57.605599577s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861779246 (12h38m57.605836106s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862035981 (12h38m57.606092841s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862356106 (12h38m57.606412969s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862436053 (12h38m57.606492918s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:36.505852265 (12h38m58.249909134s) [upload=13028]: Next returned nil segment Aug 7 22:18:36.505904890 (12h38m58.249961752s) [upload=13028]: Waiting for error group managing segments... Aug 7 22:18:36.661898608 (12h38m58.405955463s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.662658349 (12h38m58.4067152s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.672427817 (12h38m58.416484668s) [noise=true , address=104.36.82.13:4186 , piece_id=DJV6WV6OIEMPDG375GOL3KEMUI6WPM74X2HGTWPIMTEQ4TVPNY3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.673195384 (12h38m58.417252236s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.688191302 (12h38m58.432248156s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.748647081 (12h38m58.492703931s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.754316603 (12h38m58.498373455s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.757866924 (12h38m58.501923802s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.795631640 (12h38m58.539688508s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.802345397 (12h38m58.546402257s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.943130940 (12h38m58.687187793s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.569043987 (12h38m59.313100835s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628087539 (12h38m59.372144385s) [noise=true , address=104.36.82.16:4294 , piece_id=THYXT4PVF3YCWWRFQ26F7UV5VATM2YCUMKUQPVFMEDXB5V43LDAQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628112588 (12h38m59.372169448s) [seg_pos={0 0}, upload=13028]: Segment reached optimal threshold of 13 pieces. Aug 7 22:18:37.628331778 (12h38m59.372388642s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Aug 7 22:18:37.628789234 (12h38m59.372846099s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection Aug 7 22:18:37.628909632 (12h38m59.372966496s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection Aug 7 22:18:37.628933550 (12h38m59.37299042s) [seg_pos={0 0}, upload=13028]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 22:18:37.629080212 (12h38m59.37313708s) [upload=13028]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:18:37.629088669 (12h38m59.373145541s) [upload=13028]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:31.034302254 (12h42m52.778359114s) [upload=13028]: Done uploading segments... Aug 7 22:22:31.034330509 (12h42m52.77838737s) [upload=13028]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:22:31.496201038 (12h42m53.240257897s) [upload=13082]: Starting upload Aug 7 22:22:31.496288429 (12h42m53.24034529s) [upload=13082]: Done starting upload Aug 7 22:22:31.496419106 (12h42m53.240475958s) [upload=13082]: Uploading segments... Aug 7 22:22:31.496560071 (12h42m53.240616919s) [upload=13082]: Got next segment. Inline: false Aug 7 22:22:31.496599327 (12h42m53.240656175s) [upload=13082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:22:31.496604367 (12h42m53.240661227s) [upload=13082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:23:01.218010293 (12h43m22.962067243s) [upload=13082]: Next segment err: context deadline exceeded Aug 7 22:23:01.218145129 (12h43m22.962201978s) [upload=13082]: Done uploading segments... Aug 7 22:23:01.218179309 (12h43m22.962236162s) [upload=13082]: Upload finished. err: context deadline exceeded Duration: 30.000872941s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXX......X................................X.XXXXXXXXXX] duration: 1m0.000492633s FAIL (2025-08-07 22:22:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (12h32m58.30386044s) [upload=12938]: Uploading segments... Aug 7 22:12:36.560034082 (12h32m58.304090945s) [upload=12938]: Got next segment. Inline: true Aug 7 22:12:36.560041392 (12h32m58.304098252s) [upload=12938]: Waiting for error group managing segments... Aug 7 22:12:36.560151251 (12h32m58.304208113s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:12:36.560159993 (12h32m58.304216852s) [upload=12938]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:12:36.560164091 (12h32m58.304220952s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:36.275827133 (12h33m58.019883992s) [upload=12938]: Done uploading segments... Aug 7 22:13:36.275867976 (12h33m58.019924837s) [upload=12938]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:36.703916041 (12h33m58.447972892s) [upload=12954]: Starting upload Aug 7 22:13:36.704016678 (12h33m58.448073543s) [upload=12954]: Done starting upload Aug 7 22:13:36.704126028 (12h33m58.448182877s) [upload=12954]: Uploading segments... Aug 7 22:13:36.704202003 (12h33m58.448258875s) [upload=12954]: Got next segment. Inline: true Aug 7 22:13:36.704208724 (12h33m58.448265583s) [upload=12954]: Waiting for error group managing segments... Aug 7 22:13:36.704253077 (12h33m58.44830994s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:36.704259505 (12h33m58.448316353s) [upload=12954]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:36.704263329 (12h33m58.448320184s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:36.426520849 (12h34m58.170577716s) [upload=12954]: Done uploading segments... Aug 7 22:14:36.426547324 (12h34m58.170604188s) [upload=12954]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:36.851362491 (12h34m58.595419352s) [upload=12969]: Starting upload Aug 7 22:14:36.851438058 (12h34m58.595494919s) [upload=12969]: Done starting upload Aug 7 22:14:36.851531336 (12h34m58.595588182s) [upload=12969]: Uploading segments... Aug 7 22:14:36.851620028 (12h34m58.595676898s) [upload=12969]: Got next segment. Inline: true Aug 7 22:14:36.851627191 (12h34m58.595684056s) [upload=12969]: Waiting for error group managing segments... Aug 7 22:14:36.851698724 (12h34m58.595755585s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:36.851706200 (12h34m58.595763081s) [upload=12969]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:36.851710849 (12h34m58.595767717s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:36.582802839 (12h35m58.326859693s) [upload=12969]: Done uploading segments... Aug 7 22:15:36.582825807 (12h35m58.326882658s) [upload=12969]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:37.013505363 (12h35m58.757562231s) [upload=12985]: Starting upload Aug 7 22:15:37.013605304 (12h35m58.757662168s) [upload=12985]: Done starting upload Aug 7 22:15:37.013715315 (12h35m58.757772164s) [upload=12985]: Uploading segments... Aug 7 22:15:37.013761212 (12h35m58.757818081s) [upload=12985]: Got next segment. Inline: true Aug 7 22:15:37.013776983 (12h35m58.757833843s) [upload=12985]: Waiting for error group managing segments... Aug 7 22:15:37.013820691 (12h35m58.757877552s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:37.013826603 (12h35m58.757883467s) [upload=12985]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:37.013830513 (12h35m58.757887374s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:36.733288222 (12h36m58.477345085s) [upload=12985]: Done uploading segments... Aug 7 22:16:36.733314893 (12h36m58.477371754s) [upload=12985]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:37.187949023 (12h36m58.932005874s) [upload=13003]: Starting upload Aug 7 22:16:37.188024595 (12h36m58.932081456s) [upload=13003]: Done starting upload Aug 7 22:16:37.188115827 (12h36m58.932172677s) [upload=13003]: Uploading segments... Aug 7 22:16:37.188173315 (12h36m58.932230182s) [upload=13003]: Got next segment. Inline: true Aug 7 22:16:37.188181498 (12h36m58.932238365s) [upload=13003]: Waiting for error group managing segments... Aug 7 22:16:37.188252566 (12h36m58.932309427s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:37.188260045 (12h36m58.932316913s) [upload=13003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:37.188263607 (12h36m58.932320469s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:36.907306861 (12h37m58.651363739s) [upload=13003]: Done uploading segments... Aug 7 22:17:36.907340408 (12h37m58.651397275s) [upload=13003]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:46.749223731 (12h38m8.493280581s) [upload=13019]: Starting upload Aug 7 22:17:46.749288163 (12h38m8.493345017s) [upload=13019]: Done starting upload Aug 7 22:17:46.749381044 (12h38m8.493437894s) [upload=13019]: Uploading segments... Aug 7 22:17:46.749423663 (12h38m8.493480532s) [upload=13019]: Got next segment. Inline: true Aug 7 22:17:46.749428712 (12h38m8.493485573s) [upload=13019]: Waiting for error group managing segments... Aug 7 22:17:46.749471140 (12h38m8.49352799s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:46.749476259 (12h38m8.493533119s) [upload=13019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:46.749479952 (12h38m8.493536802s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:46.471549080 (12h39m8.215605941s) [upload=13019]: Done uploading segments... Aug 7 22:18:46.471571547 (12h39m8.215628407s) [upload=13019]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:46.904761993 (12h39m8.648818857s) [upload=13033]: Starting upload Aug 7 22:18:46.904856076 (12h39m8.648912937s) [upload=13033]: Done starting upload Aug 7 22:18:46.904960146 (12h39m8.649017s) [upload=13033]: Uploading segments... Aug 7 22:18:46.905047245 (12h39m8.649104114s) [upload=13033]: Got next segment. Inline: true Aug 7 22:18:46.905056198 (12h39m8.649113053s) [upload=13033]: Waiting for error group managing segments... Aug 7 22:18:46.905116687 (12h39m8.649173538s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:46.905122460 (12h39m8.649179309s) [upload=13033]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:46.905126367 (12h39m8.649183281s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:46.626010888 (12h40m8.370067739s) [upload=13033]: Done uploading segments... Aug 7 22:19:46.626032620 (12h40m8.370089471s) [upload=13033]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:59.643579230 (12h40m21.387636081s) [upload=13050]: Starting upload Aug 7 22:19:59.643668904 (12h40m21.387725771s) [upload=13050]: Done starting upload Aug 7 22:19:59.643785033 (12h40m21.38784188s) [upload=13050]: Uploading segments... Aug 7 22:19:59.643889787 (12h40m21.387946639s) [upload=13050]: Got next segment. Inline: true Aug 7 22:19:59.643897379 (12h40m21.387954229s) [upload=13050]: Waiting for error group managing segments... Aug 7 22:19:59.643957450 (12h40m21.388014313s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:59.643962932 (12h40m21.388019793s) [upload=13050]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:59.643966291 (12h40m21.388023151s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:59.369875577 (12h41m21.113932442s) [upload=13050]: Done uploading segments... Aug 7 22:20:59.369905671 (12h41m21.113962518s) [upload=13050]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:59.787948456 (12h41m21.532005324s) [upload=13064]: Starting upload Aug 7 22:20:59.788068842 (12h41m21.53212571s) [upload=13064]: Done starting upload Aug 7 22:20:59.788168587 (12h41m21.532225457s) [upload=13064]: Uploading segments... Aug 7 22:20:59.788311286 (12h41m21.532368151s) [upload=13064]: Got next segment. Inline: true Aug 7 22:20:59.788318759 (12h41m21.532375633s) [upload=13064]: Waiting for error group managing segments... Aug 7 22:20:59.788388410 (12h41m21.532445276s) [upload=13064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:59.788394823 (12h41m21.532451689s) [upload=13064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:59.788398689 (12h41m21.532455554s) [upload=13064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:21:59.519361969 (12h42m21.263418825s) [upload=13064]: Done uploading segments... Aug 7 22:21:59.519387607 (12h42m21.263444468s) [upload=13064]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:21:59.945997169 (12h42m21.69005402s) [upload=13075]: Starting upload Aug 7 22:21:59.946071844 (12h42m21.690129359s) [upload=13075]: Done starting upload Aug 7 22:21:59.946178905 (12h42m21.690235754s) [upload=13075]: Uploading segments... Aug 7 22:21:59.946230067 (12h42m21.690286936s) [upload=13075]: Got next segment. Inline: true Aug 7 22:21:59.946235138 (12h42m21.690292002s) [upload=13075]: Waiting for error group managing segments... Aug 7 22:21:59.946295164 (12h42m21.690352024s) [upload=13075]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:21:59.946300535 (12h42m21.690357396s) [upload=13075]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:21:59.946303920 (12h42m21.69036078s) [upload=13075]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:59.677780729 (12h43m21.421837589s) [upload=13075]: Done uploading segments... Aug 7 22:22:59.677798007 (12h43m21.421854868s) [upload=13075]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.000522502s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.....X.........X..X...........X.....................] duration: 3.755917191s FAIL (2025-08-07 22:22:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 5.727759364s) [upload=12820]: Starting upload Aug 7 22:05:23.983754833 (12h25m45.727811679s) [upload=12820]: Done starting upload Aug 7 22:05:23.983988533 (12h25m45.728045379s) [upload=12820]: Uploading segments... Aug 7 22:05:23.984022348 (12h25m45.728079214s) [upload=12820]: Got next segment. Inline: false Aug 7 22:05:23.984055700 (12h25m45.728112548s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:05:23.984060538 (12h25m45.728117398s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:05:24.185392691 (12h25m45.929449561s) [seg_pos={0 0}, upload=12820]: Begin upload segment... Aug 7 22:05:24.185557956 (12h25m45.929614817s) [seg_pos={0 0}, upload=12820]: Done begin upload segment. Aug 7 22:05:24.185603301 (12h25m45.929660177s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186037040 (12h25m45.930093906s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186570414 (12h25m45.930627287s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186824559 (12h25m45.930881425s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187208122 (12h25m45.931264991s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187658761 (12h25m45.931715627s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187940002 (12h25m45.931996872s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188116203 (12h25m45.932173069s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188531115 (12h25m45.932587976s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188637273 (12h25m45.932694145s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188961006 (12h25m45.933017872s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189183712 (12h25m45.933240578s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189352560 (12h25m45.933409422s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189640677 (12h25m45.93369755s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189855650 (12h25m45.933912517s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190187162 (12h25m45.934244033s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190334028 (12h25m45.934390898s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190661949 (12h25m45.934718816s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.754845434 (12h25m46.498902284s) [upload=12820]: Next returned nil segment Aug 7 22:05:24.754862619 (12h25m46.49891948s) [upload=12820]: Waiting for error group managing segments... Aug 7 22:05:24.937656798 (12h25m46.681713649s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.980443483 (12h25m46.724500333s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.995491860 (12h25m46.739551452s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.083772095 (12h25m46.827828964s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.147179204 (12h25m46.891236066s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.274393636 (12h25m47.018450492s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.452784464 (12h25m47.196841314s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.474459740 (12h25m47.218516586s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.481247102 (12h25m47.225303949s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666066275 (12h25m47.410123138s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666429351 (12h25m47.410486202s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.782101005 (12h25m47.526157853s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.863469768 (12h25m47.607526622s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865162168 (12h25m47.609219032s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865201343 (12h25m47.609258205s) [seg_pos={0 0}, upload=12820]: Segment reached optimal threshold of 14 pieces. Aug 7 22:05:25.865362755 (12h25m47.609419601s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865412734 (12h25m47.609469599s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nhwT2THUu6ptumqU9Bz1Nd34FHLewx9vWjGFC34j3Lz3RWfkw): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865468394 (12h25m47.609525241s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sUT7LBYFqWMUhx7MMjEmyiFDnbJnjSVndNbTaHioaVLLSXYue): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865629517 (12h25m47.609686385s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1akHUSoQFafzkGTJ385iYaowc87pJBDNfU5hodSCUDFa5ojN3v): protocol: write tcp 139.59.144.22:45386->104.36.82.22:4530: use of closed network connection; context canceled Aug 7 22:05:25.865657252 (12h25m47.609714121s) [seg_pos={0 0}, upload=12820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:05:25.865814825 (12h25m47.609871688s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:05:25.865822925 (12h25m47.609879795s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:05:26.138690358 (12h25m47.882747231s) [upload=12820]: Done uploading segments... Aug 7 22:05:26.138713087 (12h25m47.882769948s) [upload=12820]: Upload finished. err: <nil> Duration: 3.755953576s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [XXXX.X..........................................XXXXXXXXXXXX] duration: 30.000600318s FAIL (2025-08-07 22:22:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000623002s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 109.781618ms remote: "tcp:185.244.226.2:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-07 22:22:47 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 109.811572ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 26 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX......X.X...........................XXXXXXXXXXX] duration: 1m0.001366268s FAIL (2025-08-07 22:22:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001395518s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXX.....................................XXXXXXXXXXXXX] duration: 30.000469611s FAIL (2025-08-07 22:22:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000491432s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...X..........................X..] duration: 830.969447ms FAIL (2025-08-07 22:22:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== oad=12946]: Done uploading segments... Aug 7 22:13:06.973788967 (12h33m28.717845817s) [upload=12946]: Upload finished. err: <nil> Aug 7 22:13:30.021513352 (12h33m51.765570214s) [upload=12952]: Starting upload Aug 7 22:13:30.021593609 (12h33m51.76565047s) [upload=12952]: Done starting upload Aug 7 22:13:30.021654614 (12h33m51.765711463s) [upload=12952]: Uploading segments... Aug 7 22:13:30.021737458 (12h33m51.765794327s) [upload=12952]: Got next segment. Inline: true Aug 7 22:13:30.021744385 (12h33m51.765801246s) [upload=12952]: Waiting for error group managing segments... Aug 7 22:13:30.021806243 (12h33m51.765863106s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:30.021811954 (12h33m51.765868813s) [upload=12952]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:30.021815203 (12h33m51.765872063s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:30.450767059 (12h33m52.194823912s) [upload=12952]: Done uploading segments... Aug 7 22:13:30.450786964 (12h33m52.194843815s) [upload=12952]: Upload finished. err: <nil> Aug 7 22:14:24.441642672 (12h34m46.185699519s) [upload=12964]: Starting upload Aug 7 22:14:24.441731987 (12h34m46.185788849s) [upload=12964]: Done starting upload Aug 7 22:14:24.441844223 (12h34m46.185901069s) [upload=12964]: Uploading segments... Aug 7 22:14:24.441952356 (12h34m46.186009238s) [upload=12964]: Got next segment. Inline: true Aug 7 22:14:24.441960404 (12h34m46.186017265s) [upload=12964]: Waiting for error group managing segments... Aug 7 22:14:24.442032277 (12h34m46.186089141s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:24.442038920 (12h34m46.186095769s) [upload=12964]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:24.442045324 (12h34m46.186102193s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:24.691130502 (12h34m46.435187353s) [upload=12964]: Done uploading segments... Aug 7 22:14:24.691168009 (12h34m46.435224859s) [upload=12964]: Upload finished. err: <nil> Aug 7 22:14:52.288782940 (12h35m14.032839801s) [upload=12974]: Starting upload Aug 7 22:14:52.288924660 (12h35m14.032981562s) [upload=12974]: Done starting upload Aug 7 22:14:52.288991726 (12h35m14.033048572s) [upload=12974]: Uploading segments... Aug 7 22:14:52.289071270 (12h35m14.033128145s) [upload=12974]: Got next segment. Inline: true Aug 7 22:14:52.289078867 (12h35m14.033135735s) [upload=12974]: Waiting for error group managing segments... Aug 7 22:14:52.289164039 (12h35m14.0332209s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:52.289171651 (12h35m14.033228513s) [upload=12974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:52.289176583 (12h35m14.033233444s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:52.452595224 (12h35m14.196652085s) [upload=12974]: Done uploading segments... Aug 7 22:14:52.452614952 (12h35m14.196671802s) [upload=12974]: Upload finished. err: <nil> Aug 7 22:15:58.755852650 (12h36m20.499909522s) [upload=12993]: Starting upload Aug 7 22:15:58.755930601 (12h36m20.499987455s) [upload=12993]: Done starting upload Aug 7 22:15:58.756035921 (12h36m20.500092782s) [upload=12993]: Uploading segments... Aug 7 22:15:58.756122656 (12h36m20.500179529s) [upload=12993]: Got next segment. Inline: true Aug 7 22:15:58.756129927 (12h36m20.500186799s) [upload=12993]: Waiting for error group managing segments... Aug 7 22:15:58.756200897 (12h36m20.500257762s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:58.756207605 (12h36m20.500264472s) [upload=12993]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:58.756211651 (12h36m20.500268513s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:58.903437708 (12h36m20.647494557s) [upload=12993]: Done uploading segments... Aug 7 22:15:58.903462384 (12h36m20.647519231s) [upload=12993]: Upload finished. err: <nil> Aug 7 22:16:15.337485833 (12h36m37.081542697s) [upload=12998]: Starting upload Aug 7 22:16:15.337573316 (12h36m37.081630164s) [upload=12998]: Done starting upload Aug 7 22:16:15.337667907 (12h36m37.081724797s) [upload=12998]: Uploading segments... Aug 7 22:16:15.337814382 (12h36m37.081871252s) [upload=12998]: Got next segment. Inline: true Aug 7 22:16:15.337826053 (12h36m37.081882921s) [upload=12998]: Waiting for error group managing segments... Aug 7 22:16:15.337898669 (12h36m37.08195553s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.337905734 (12h36m37.081962605s) [upload=12998]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.337934067 (12h36m37.081990931s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.509139020 (12h36m37.253195886s) [upload=12998]: Done uploading segments... Aug 7 22:16:15.509165009 (12h36m37.253221873s) [upload=12998]: Upload finished. err: <nil> Aug 7 22:16:46.696796765 (12h37m8.440853615s) [upload=13006]: Starting upload Aug 7 22:16:46.696851500 (12h37m8.440908351s) [upload=13006]: Done starting upload Aug 7 22:16:46.696919178 (12h37m8.44097604s) [upload=13006]: Uploading segments... Aug 7 22:16:46.696965400 (12h37m8.441022269s) [upload=13006]: Got next segment. Inline: true Aug 7 22:16:46.696970111 (12h37m8.441026962s) [upload=13006]: Waiting for error group managing segments... Aug 7 22:16:46.697010995 (12h37m8.441067847s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:46.697016018 (12h37m8.441072868s) [upload=13006]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:46.697019675 (12h37m8.44107653s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:46.874265238 (12h37m8.618322106s) [upload=13006]: Done uploading segments... Aug 7 22:16:46.874318422 (12h37m8.618375284s) [upload=13006]: Upload finished. err: <nil> Aug 7 22:17:54.674081400 (12h38m16.418138249s) [upload=13021]: Starting upload Aug 7 22:17:54.674159403 (12h38m16.418216253s) [upload=13021]: Done starting upload Aug 7 22:17:54.674269670 (12h38m16.418326517s) [upload=13021]: Uploading segments... Aug 7 22:17:54.674363154 (12h38m16.418420014s) [upload=13021]: Got next segment. Inline: true Aug 7 22:17:54.674369843 (12h38m16.418426703s) [upload=13021]: Waiting for error group managing segments... Aug 7 22:17:54.674442390 (12h38m16.418499251s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:54.674447948 (12h38m16.418504799s) [upload=13021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:54.674451453 (12h38m16.418508313s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:54.827409307 (12h38m16.571466155s) [upload=13021]: Done uploading segments... Aug 7 22:17:54.827433528 (12h38m16.571490374s) [upload=13021]: Upload finished. err: <nil> Aug 7 22:19:01.440458592 (12h39m23.184515453s) [upload=13036]: Starting upload Aug 7 22:19:01.440570182 (12h39m23.184627051s) [upload=13036]: Done starting upload Aug 7 22:19:01.440699423 (12h39m23.184756285s) [upload=13036]: Uploading segments... Aug 7 22:19:01.440794556 (12h39m23.184851411s) [upload=13036]: Got next segment. Inline: true Aug 7 22:19:01.440803141 (12h39m23.184860002s) [upload=13036]: Waiting for error group managing segments... Aug 7 22:19:01.440879672 (12h39m23.184936519s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:01.440886345 (12h39m23.184943191s) [upload=13036]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:01.440890294 (12h39m23.184947158s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:01.709467042 (12h39m23.45352391s) [upload=13036]: Done uploading segments... Aug 7 22:19:01.709491674 (12h39m23.453548536s) [upload=13036]: Upload finished. err: <nil> Aug 7 22:19:45.253186247 (12h40m6.997243094s) [upload=13047]: Starting upload Aug 7 22:19:45.253237927 (12h40m6.997294773s) [upload=13047]: Done starting upload Aug 7 22:19:45.253295065 (12h40m6.997351912s) [upload=13047]: Uploading segments... Aug 7 22:19:45.253376256 (12h40m6.997433124s) [upload=13047]: Got next segment. Inline: true Aug 7 22:19:45.253382535 (12h40m6.997439396s) [upload=13047]: Waiting for error group managing segments... Aug 7 22:19:45.253441431 (12h40m6.997498291s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:45.253446448 (12h40m6.997503294s) [upload=13047]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:45.253449347 (12h40m6.997506208s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:45.480979982 (12h40m7.225036832s) [upload=13047]: Done uploading segments... Aug 7 22:19:45.480999304 (12h40m7.22505615s) [upload=13047]: Upload finished. err: <nil> Aug 7 22:20:54.671307886 (12h41m16.415364754s) [upload=13061]: Starting upload Aug 7 22:20:54.671398239 (12h41m16.41545511s) [upload=13061]: Done starting upload Aug 7 22:20:54.671491892 (12h41m16.415548958s) [upload=13061]: Uploading segments... Aug 7 22:20:54.671578785 (12h41m16.415635652s) [upload=13061]: Got next segment. Inline: true Aug 7 22:20:54.671585361 (12h41m16.415642224s) [upload=13061]: Waiting for error group managing segments... Aug 7 22:20:54.671656504 (12h41m16.415713357s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:54.671670437 (12h41m16.415727303s) [upload=13061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:54.671692679 (12h41m16.415749544s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:54.840367361 (12h41m16.584424221s) [upload=13061]: Done uploading segments... Aug 7 22:20:54.840387040 (12h41m16.5844439s) [upload=13061]: Upload finished. err: <nil> Duration: 831.01723ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXXX....X...................................XXXXXXXX] duration: 4m10.828372459s FAIL (2025-08-07 22:22:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== g 7 22:17:11.073526596 (12h37m32.817583458s) [upload=13012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:11.073532686 (12h37m32.817589547s) [upload=13012]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:17:40.800030583 (12h38m2.54408743s) [upload=13012]: Next segment err: context deadline exceeded Aug 7 22:17:40.800057653 (12h38m2.544114513s) [upload=13012]: Done uploading segments... Aug 7 22:17:40.800086865 (12h38m2.544143711s) [upload=13012]: Upload finished. err: context deadline exceeded Aug 7 22:18:20.484853554 (12h38m42.228910424s) [upload=13028]: Starting upload Aug 7 22:18:20.484956510 (12h38m42.229013382s) [upload=13028]: Done starting upload Aug 7 22:18:20.485488243 (12h38m42.229545099s) [upload=13028]: Uploading segments... Aug 7 22:18:20.485578014 (12h38m42.229634876s) [upload=13028]: Got next segment. Inline: false Aug 7 22:18:20.485638921 (12h38m42.229695786s) [upload=13028]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:20.485645374 (12h38m42.229702242s) [upload=13028]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:18:35.859004202 (12h38m57.603061071s) [seg_pos={0 0}, upload=13028]: Begin upload segment... Aug 7 22:18:35.859066970 (12h38m57.603123828s) [seg_pos={0 0}, upload=13028]: Done begin upload segment. Aug 7 22:18:35.859099123 (12h38m57.603155989s) [noise=true , address=104.36.82.13:4186 , piece_id=DJV6WV6OIEMPDG375GOL3KEMUI6WPM74X2HGTWPIMTEQ4TVPNY3Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859111400 (12h38m57.603168271s) [noise=true , address=104.36.82.16:4294 , piece_id=THYXT4PVF3YCWWRFQ26F7UV5VATM2YCUMKUQPVFMEDXB5V43LDAQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859573268 (12h38m57.603630132s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859636824 (12h38m57.603693684s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859812093 (12h38m57.603868953s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.859925097 (12h38m57.603981964s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860231094 (12h38m57.604287959s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860523549 (12h38m57.604580412s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.860874877 (12h38m57.604931741s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861016178 (12h38m57.605073041s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861300910 (12h38m57.605357771s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861542714 (12h38m57.605599577s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.861779246 (12h38m57.605836106s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862035981 (12h38m57.606092841s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862356106 (12h38m57.606412969s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:35.862436053 (12h38m57.606492918s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Uploading piece... Aug 7 22:18:36.505852265 (12h38m58.249909134s) [upload=13028]: Next returned nil segment Aug 7 22:18:36.505904890 (12h38m58.249961752s) [upload=13028]: Waiting for error group managing segments... Aug 7 22:18:36.661898608 (12h38m58.405955463s) [noise=true , address=104.36.82.15:4259 , piece_id=HMXZL45RSQH3W2AC6ME5GX3AQK6N5V2DHT5VZEIBQOSXR5BPZ46Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.662658349 (12h38m58.4067152s) [noise=true , address=104.36.82.7:4911 , piece_id=LRDJMRHFXZOBLCZO7QG6QYHXK5N5L2HNQJ4O6B4ADPAF7LLQRLXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.672427817 (12h38m58.416484668s) [noise=true , address=104.36.82.13:4186 , piece_id=DJV6WV6OIEMPDG375GOL3KEMUI6WPM74X2HGTWPIMTEQ4TVPNY3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.673195384 (12h38m58.417252236s) [noise=true , address=45.91.116.10:4082 , piece_id=LBILSHTHZUOWII4YKENYEUFMBHSWY6H33CGLRUBIAHM6OM6DTS4Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.688191302 (12h38m58.432248156s) [noise=true , address=104.36.82.2:4729 , piece_id=JOM3CIEISZKSZDIRWOWMPXJ2RJO3EPAKL7JXCIRFXKDDLQAJNDUA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.748647081 (12h38m58.492703931s) [noise=true , address=77.90.31.18:4805 , piece_id=XI5JFRSIBI4R6TOQ4A6B3U4KVIIAAAA645YYME2H7OIYJDYK63HA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.754316603 (12h38m58.498373455s) [noise=true , address=77.90.31.11:4555 , piece_id=ZIU4KSSZL2ARD73QDPY42TNS34DMONTWE5YTKWXEAWG4E2MVZIXQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.757866924 (12h38m58.501923802s) [noise=true , address=77.90.31.13:4627 , piece_id=D5KZZ5JSSE7H327MVZ2XSPJKVLH3LDTLPKIQCD3VAYMLCKXYCNBA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.795631640 (12h38m58.539688508s) [noise=true , address=104.36.82.11:4114 , piece_id=GZL3NQ6GN52UBG3SYAO254PFKKUIBLV674DRL57FDGLSA2SVZIZQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.802345397 (12h38m58.546402257s) [noise=true , address=77.90.31.16:4734 , piece_id=J4XNXI4QVDW2DTTNNJ3ZYYKEJKDNAXDQ56A645S4CRHYTVBTNTRQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:36.943130940 (12h38m58.687187793s) [noise=true , address=104.36.82.6:4875 , piece_id=WIVGBYJRKDHKW42FYCB7PALD7AWLFQZC7WGRLWA4HFIYNLSHPZGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.569043987 (12h38m59.313100835s) [noise=true , address=77.90.31.15:4699 , piece_id=B2PK3OHPJMX26WOOCHMXYUFA7DMG2KSIY6KAVKDJAWAL7FOUTMRA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628087539 (12h38m59.372144385s) [noise=true , address=104.36.82.16:4294 , piece_id=THYXT4PVF3YCWWRFQ26F7UV5VATM2YCUMKUQPVFMEDXB5V43LDAQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: <nil> Aug 7 22:18:37.628112588 (12h38m59.372169448s) [seg_pos={0 0}, upload=13028]: Segment reached optimal threshold of 13 pieces. Aug 7 22:18:37.628331778 (12h38m59.372388642s) [noise=true , address=77.90.31.21:4879 , piece_id=QOG2A5SRMKGU5EJ2R6MVUF7UYIYKOJ3MROJZMJ4MGH7X5BNITGGQ, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Aug 7 22:18:37.628789234 (12h38m59.372846099s) [noise=true , address=45.91.116.10:4083 , piece_id=BNTXWCSLYD3DYHVBTJEEAWV756XVE3W6HOFHKBYXOHETDAH42Z3Q, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52486->45.91.116.10:4083: use of closed network connection Aug 7 22:18:37.628909632 (12h38m59.372966496s) [noise=true , address=104.36.82.4:4804 , piece_id=AMESQ5Z4KOMYXBJJECEZ4UW3SBYSRCUGLYMKH7JBZGYGJF7NSVZA, seg_pos={0 0}, upload=13028]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53518->104.36.82.4:4804: use of closed network connection Aug 7 22:18:37.628933550 (12h38m59.37299042s) [seg_pos={0 0}, upload=13028]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 22:18:37.629080212 (12h38m59.37313708s) [upload=13028]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:18:37.629088669 (12h38m59.373145541s) [upload=13028]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:31.034302254 (12h42m52.778359114s) [upload=13028]: Done uploading segments... Aug 7 22:22:31.034330509 (12h42m52.77838737s) [upload=13028]: Upload finished. err: metaclient: context deadline exceeded Duration: 4m10.8283994s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 22 out of 60 is failed (threshold=3) [XXXX..X.XX..................................X.XXXXXXXXXXXXXX] duration: 30.000700458s FAIL (2025-08-07 22:22:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000730514s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 110.03548ms remote: "tcp:185.244.226.2:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-07 22:22:20 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 110.06012ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 105.40838ms remote: "tcp:185.244.226.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 22:22:19 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 105.434866ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXX.....................................XXXXXXXXXXXX] duration: 30.001357268s FAIL (2025-08-07 22:22:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001373706s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.....X.........X..X...........X....................] duration: 3.457587054s FAIL (2025-08-07 22:22:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 5.727759364s) [upload=12820]: Starting upload Aug 7 22:05:23.983754833 (12h25m45.727811679s) [upload=12820]: Done starting upload Aug 7 22:05:23.983988533 (12h25m45.728045379s) [upload=12820]: Uploading segments... Aug 7 22:05:23.984022348 (12h25m45.728079214s) [upload=12820]: Got next segment. Inline: false Aug 7 22:05:23.984055700 (12h25m45.728112548s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:05:23.984060538 (12h25m45.728117398s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:05:24.185392691 (12h25m45.929449561s) [seg_pos={0 0}, upload=12820]: Begin upload segment... Aug 7 22:05:24.185557956 (12h25m45.929614817s) [seg_pos={0 0}, upload=12820]: Done begin upload segment. Aug 7 22:05:24.185603301 (12h25m45.929660177s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186037040 (12h25m45.930093906s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186570414 (12h25m45.930627287s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186824559 (12h25m45.930881425s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187208122 (12h25m45.931264991s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187658761 (12h25m45.931715627s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187940002 (12h25m45.931996872s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188116203 (12h25m45.932173069s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188531115 (12h25m45.932587976s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188637273 (12h25m45.932694145s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188961006 (12h25m45.933017872s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189183712 (12h25m45.933240578s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189352560 (12h25m45.933409422s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189640677 (12h25m45.93369755s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189855650 (12h25m45.933912517s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190187162 (12h25m45.934244033s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190334028 (12h25m45.934390898s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190661949 (12h25m45.934718816s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.754845434 (12h25m46.498902284s) [upload=12820]: Next returned nil segment Aug 7 22:05:24.754862619 (12h25m46.49891948s) [upload=12820]: Waiting for error group managing segments... Aug 7 22:05:24.937656798 (12h25m46.681713649s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.980443483 (12h25m46.724500333s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.995491860 (12h25m46.739551452s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.083772095 (12h25m46.827828964s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.147179204 (12h25m46.891236066s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.274393636 (12h25m47.018450492s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.452784464 (12h25m47.196841314s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.474459740 (12h25m47.218516586s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.481247102 (12h25m47.225303949s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666066275 (12h25m47.410123138s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666429351 (12h25m47.410486202s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.782101005 (12h25m47.526157853s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.863469768 (12h25m47.607526622s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865162168 (12h25m47.609219032s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865201343 (12h25m47.609258205s) [seg_pos={0 0}, upload=12820]: Segment reached optimal threshold of 14 pieces. Aug 7 22:05:25.865362755 (12h25m47.609419601s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865412734 (12h25m47.609469599s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nhwT2THUu6ptumqU9Bz1Nd34FHLewx9vWjGFC34j3Lz3RWfkw): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865468394 (12h25m47.609525241s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sUT7LBYFqWMUhx7MMjEmyiFDnbJnjSVndNbTaHioaVLLSXYue): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865629517 (12h25m47.609686385s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1akHUSoQFafzkGTJ385iYaowc87pJBDNfU5hodSCUDFa5ojN3v): protocol: write tcp 139.59.144.22:45386->104.36.82.22:4530: use of closed network connection; context canceled Aug 7 22:05:25.865657252 (12h25m47.609714121s) [seg_pos={0 0}, upload=12820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:05:25.865814825 (12h25m47.609871688s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:05:25.865822925 (12h25m47.609879795s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:05:26.138690358 (12h25m47.882747231s) [upload=12820]: Done uploading segments... Aug 7 22:05:26.138713087 (12h25m47.882769948s) [upload=12820]: Upload finished. err: <nil> Duration: 3.457615916s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXX....................................XXXXXXXXXXXX.] duration: 883.487641ms FAIL (2025-08-07 22:22:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 2h33m32.576128457s) [upload=12948]: Uploading segments... Aug 7 22:13:10.832146431 (12h33m32.576203291s) [upload=12948]: Got next segment. Inline: true Aug 7 22:13:10.832152814 (12h33m32.576209674s) [upload=12948]: Waiting for error group managing segments... Aug 7 22:13:10.832208966 (12h33m32.576265827s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:10.832214384 (12h33m32.576271244s) [upload=12948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:10.832217904 (12h33m32.576274764s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:40.559928781 (12h34m2.303985629s) [upload=12948]: Done uploading segments... Aug 7 22:13:40.559950271 (12h34m2.304007117s) [upload=12948]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:48.685772427 (12h34m10.429829287s) [upload=12958]: Starting upload Aug 7 22:13:48.685858893 (12h34m10.429915753s) [upload=12958]: Done starting upload Aug 7 22:13:48.685982193 (12h34m10.430039042s) [upload=12958]: Uploading segments... Aug 7 22:13:48.686047966 (12h34m10.430104835s) [upload=12958]: Got next segment. Inline: true Aug 7 22:13:48.686053563 (12h34m10.430110423s) [upload=12958]: Waiting for error group managing segments... Aug 7 22:13:48.686096300 (12h34m10.43015316s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:48.686101341 (12h34m10.430158201s) [upload=12958]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:48.686104243 (12h34m10.430161104s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:18.399606594 (12h34m40.143663447s) [upload=12958]: Done uploading segments... Aug 7 22:14:18.399627822 (12h34m40.143684675s) [upload=12958]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:59.902619970 (12h35m21.646676816s) [upload=12977]: Starting upload Aug 7 22:14:59.902685895 (12h35m21.646742756s) [upload=12977]: Done starting upload Aug 7 22:14:59.902751694 (12h35m21.646808545s) [upload=12977]: Uploading segments... Aug 7 22:14:59.902795346 (12h35m21.646852214s) [upload=12977]: Got next segment. Inline: true Aug 7 22:14:59.902801495 (12h35m21.646858346s) [upload=12977]: Waiting for error group managing segments... Aug 7 22:14:59.902858709 (12h35m21.64691556s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:59.902863962 (12h35m21.646920811s) [upload=12977]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:59.902867458 (12h35m21.646924309s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:29.636302762 (12h35m51.380359612s) [upload=12977]: Done uploading segments... Aug 7 22:15:29.636325398 (12h35m51.380382249s) [upload=12977]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:45.428850713 (12h36m7.172907563s) [upload=12988]: Starting upload Aug 7 22:15:45.428978829 (12h36m7.173035696s) [upload=12988]: Done starting upload Aug 7 22:15:45.429103446 (12h36m7.173160298s) [upload=12988]: Uploading segments... Aug 7 22:15:45.429150754 (12h36m7.173207623s) [upload=12988]: Got next segment. Inline: true Aug 7 22:15:45.429156339 (12h36m7.173213199s) [upload=12988]: Waiting for error group managing segments... Aug 7 22:15:45.429230361 (12h36m7.173287221s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:45.429247463 (12h36m7.173304325s) [upload=12988]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:45.429251133 (12h36m7.173307993s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.155440875 (12h36m36.899497725s) [upload=12988]: Done uploading segments... Aug 7 22:16:15.155471506 (12h36m36.899528367s) [upload=12988]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:15.598565945 (12h36m37.342622791s) [upload=12999]: Starting upload Aug 7 22:16:15.598645050 (12h36m37.342701913s) [upload=12999]: Done starting upload Aug 7 22:16:15.598718650 (12h36m37.342775497s) [upload=12999]: Uploading segments... Aug 7 22:16:15.598774264 (12h36m37.34283113s) [upload=12999]: Got next segment. Inline: true Aug 7 22:16:15.598779124 (12h36m37.342835984s) [upload=12999]: Waiting for error group managing segments... Aug 7 22:16:15.598830461 (12h36m37.342887324s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.598854102 (12h36m37.342910963s) [upload=12999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.598857833 (12h36m37.342914694s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:45.328584439 (12h37m7.072641289s) [upload=12999]: Done uploading segments... Aug 7 22:16:45.328609005 (12h37m7.072665856s) [upload=12999]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:27.480756310 (12h37m49.22481316s) [upload=13015]: Starting upload Aug 7 22:17:27.480859326 (12h37m49.22491619s) [upload=13015]: Done starting upload Aug 7 22:17:27.480944450 (12h37m49.225001301s) [upload=13015]: Uploading segments... Aug 7 22:17:27.481000891 (12h37m49.225057757s) [upload=13015]: Got next segment. Inline: true Aug 7 22:17:27.481006468 (12h37m49.225063328s) [upload=13015]: Waiting for error group managing segments... Aug 7 22:17:27.481069727 (12h37m49.225126586s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:27.481076622 (12h37m49.225133484s) [upload=13015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:27.481081288 (12h37m49.225138155s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:57.211870572 (12h38m18.955927423s) [upload=13015]: Done uploading segments... Aug 7 22:17:57.211892595 (12h38m18.955949444s) [upload=13015]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:14.331617780 (12h38m36.07567463s) [upload=13026]: Starting upload Aug 7 22:18:14.331690520 (12h38m36.07574737s) [upload=13026]: Done starting upload Aug 7 22:18:14.331789874 (12h38m36.075846724s) [upload=13026]: Uploading segments... Aug 7 22:18:14.331829497 (12h38m36.075886363s) [upload=13026]: Got next segment. Inline: true Aug 7 22:18:14.331834588 (12h38m36.075891448s) [upload=13026]: Waiting for error group managing segments... Aug 7 22:18:14.331890028 (12h38m36.075946878s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:14.331895594 (12h38m36.075952444s) [upload=13026]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:14.331899378 (12h38m36.075956238s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:44.050649404 (12h39m5.794706254s) [upload=13026]: Done uploading segments... Aug 7 22:18:44.050671176 (12h39m5.794728026s) [upload=13026]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:08.682705115 (12h39m30.42676198s) [upload=13039]: Starting upload Aug 7 22:19:08.682797967 (12h39m30.426854836s) [upload=13039]: Done starting upload Aug 7 22:19:08.682924116 (12h39m30.426980968s) [upload=13039]: Uploading segments... Aug 7 22:19:08.682986486 (12h39m30.427043358s) [upload=13039]: Got next segment. Inline: true Aug 7 22:19:08.682993964 (12h39m30.427050856s) [upload=13039]: Waiting for error group managing segments... Aug 7 22:19:08.683054026 (12h39m30.427110894s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:08.683060373 (12h39m30.427117244s) [upload=13039]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:08.683064440 (12h39m30.42712131s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:38.406368834 (12h40m0.150425697s) [upload=13039]: Done uploading segments... Aug 7 22:19:38.406426692 (12h40m0.150483554s) [upload=13039]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:20.517418397 (12h40m42.26147525s) [upload=13053]: Starting upload Aug 7 22:20:20.517575991 (12h40m42.261632856s) [upload=13053]: Done starting upload Aug 7 22:20:20.517715190 (12h40m42.261772059s) [upload=13053]: Uploading segments... Aug 7 22:20:20.517901368 (12h40m42.26195823s) [upload=13053]: Got next segment. Inline: true Aug 7 22:20:20.517963476 (12h40m42.262020457s) [upload=13053]: Waiting for error group managing segments... Aug 7 22:20:20.518079988 (12h40m42.262137053s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:20.518123882 (12h40m42.262180743s) [upload=13053]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:20.518130819 (12h40m42.262187685s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:50.250392650 (12h41m11.994449511s) [upload=13053]: Done uploading segments... Aug 7 22:20:50.250418123 (12h41m11.994474984s) [upload=13053]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:21:32.413463521 (12h41m54.157520381s) [upload=13069]: Starting upload Aug 7 22:21:32.413532657 (12h41m54.157589509s) [upload=13069]: Done starting upload Aug 7 22:21:32.413608430 (12h41m54.157665281s) [upload=13069]: Uploading segments... Aug 7 22:21:32.413661653 (12h41m54.157718517s) [upload=13069]: Got next segment. Inline: true Aug 7 22:21:32.413666698 (12h41m54.157723558s) [upload=13069]: Waiting for error group managing segments... Aug 7 22:21:32.413708373 (12h41m54.157765222s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:21:32.413713536 (12h41m54.157770396s) [upload=13069]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:21:32.413727266 (12h41m54.157784127s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:02.144247861 (12h42m23.888304727s) [upload=13069]: Done uploading segments... Aug 7 22:22:02.144276519 (12h42m23.888333383s) [upload=13069]: Upload finished. err: metaclient: context deadline exceeded Duration: 883.596174ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 24 out of 60 is failed (threshold=3) [XXXXXXXXXXXX....................................XXXXXXXXXXXX] duration: 30.003367483s FAIL (2025-08-07 22:22:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 2h33m32.576128457s) [upload=12948]: Uploading segments... Aug 7 22:13:10.832146431 (12h33m32.576203291s) [upload=12948]: Got next segment. Inline: true Aug 7 22:13:10.832152814 (12h33m32.576209674s) [upload=12948]: Waiting for error group managing segments... Aug 7 22:13:10.832208966 (12h33m32.576265827s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:10.832214384 (12h33m32.576271244s) [upload=12948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:10.832217904 (12h33m32.576274764s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:40.559928781 (12h34m2.303985629s) [upload=12948]: Done uploading segments... Aug 7 22:13:40.559950271 (12h34m2.304007117s) [upload=12948]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:48.685772427 (12h34m10.429829287s) [upload=12958]: Starting upload Aug 7 22:13:48.685858893 (12h34m10.429915753s) [upload=12958]: Done starting upload Aug 7 22:13:48.685982193 (12h34m10.430039042s) [upload=12958]: Uploading segments... Aug 7 22:13:48.686047966 (12h34m10.430104835s) [upload=12958]: Got next segment. Inline: true Aug 7 22:13:48.686053563 (12h34m10.430110423s) [upload=12958]: Waiting for error group managing segments... Aug 7 22:13:48.686096300 (12h34m10.43015316s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:48.686101341 (12h34m10.430158201s) [upload=12958]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:48.686104243 (12h34m10.430161104s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:18.399606594 (12h34m40.143663447s) [upload=12958]: Done uploading segments... Aug 7 22:14:18.399627822 (12h34m40.143684675s) [upload=12958]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:59.902619970 (12h35m21.646676816s) [upload=12977]: Starting upload Aug 7 22:14:59.902685895 (12h35m21.646742756s) [upload=12977]: Done starting upload Aug 7 22:14:59.902751694 (12h35m21.646808545s) [upload=12977]: Uploading segments... Aug 7 22:14:59.902795346 (12h35m21.646852214s) [upload=12977]: Got next segment. Inline: true Aug 7 22:14:59.902801495 (12h35m21.646858346s) [upload=12977]: Waiting for error group managing segments... Aug 7 22:14:59.902858709 (12h35m21.64691556s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:59.902863962 (12h35m21.646920811s) [upload=12977]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:59.902867458 (12h35m21.646924309s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:29.636302762 (12h35m51.380359612s) [upload=12977]: Done uploading segments... Aug 7 22:15:29.636325398 (12h35m51.380382249s) [upload=12977]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:45.428850713 (12h36m7.172907563s) [upload=12988]: Starting upload Aug 7 22:15:45.428978829 (12h36m7.173035696s) [upload=12988]: Done starting upload Aug 7 22:15:45.429103446 (12h36m7.173160298s) [upload=12988]: Uploading segments... Aug 7 22:15:45.429150754 (12h36m7.173207623s) [upload=12988]: Got next segment. Inline: true Aug 7 22:15:45.429156339 (12h36m7.173213199s) [upload=12988]: Waiting for error group managing segments... Aug 7 22:15:45.429230361 (12h36m7.173287221s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:45.429247463 (12h36m7.173304325s) [upload=12988]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:45.429251133 (12h36m7.173307993s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.155440875 (12h36m36.899497725s) [upload=12988]: Done uploading segments... Aug 7 22:16:15.155471506 (12h36m36.899528367s) [upload=12988]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:15.598565945 (12h36m37.342622791s) [upload=12999]: Starting upload Aug 7 22:16:15.598645050 (12h36m37.342701913s) [upload=12999]: Done starting upload Aug 7 22:16:15.598718650 (12h36m37.342775497s) [upload=12999]: Uploading segments... Aug 7 22:16:15.598774264 (12h36m37.34283113s) [upload=12999]: Got next segment. Inline: true Aug 7 22:16:15.598779124 (12h36m37.342835984s) [upload=12999]: Waiting for error group managing segments... Aug 7 22:16:15.598830461 (12h36m37.342887324s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.598854102 (12h36m37.342910963s) [upload=12999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.598857833 (12h36m37.342914694s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:45.328584439 (12h37m7.072641289s) [upload=12999]: Done uploading segments... Aug 7 22:16:45.328609005 (12h37m7.072665856s) [upload=12999]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:27.480756310 (12h37m49.22481316s) [upload=13015]: Starting upload Aug 7 22:17:27.480859326 (12h37m49.22491619s) [upload=13015]: Done starting upload Aug 7 22:17:27.480944450 (12h37m49.225001301s) [upload=13015]: Uploading segments... Aug 7 22:17:27.481000891 (12h37m49.225057757s) [upload=13015]: Got next segment. Inline: true Aug 7 22:17:27.481006468 (12h37m49.225063328s) [upload=13015]: Waiting for error group managing segments... Aug 7 22:17:27.481069727 (12h37m49.225126586s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:27.481076622 (12h37m49.225133484s) [upload=13015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:27.481081288 (12h37m49.225138155s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:57.211870572 (12h38m18.955927423s) [upload=13015]: Done uploading segments... Aug 7 22:17:57.211892595 (12h38m18.955949444s) [upload=13015]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:14.331617780 (12h38m36.07567463s) [upload=13026]: Starting upload Aug 7 22:18:14.331690520 (12h38m36.07574737s) [upload=13026]: Done starting upload Aug 7 22:18:14.331789874 (12h38m36.075846724s) [upload=13026]: Uploading segments... Aug 7 22:18:14.331829497 (12h38m36.075886363s) [upload=13026]: Got next segment. Inline: true Aug 7 22:18:14.331834588 (12h38m36.075891448s) [upload=13026]: Waiting for error group managing segments... Aug 7 22:18:14.331890028 (12h38m36.075946878s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:14.331895594 (12h38m36.075952444s) [upload=13026]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:14.331899378 (12h38m36.075956238s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:44.050649404 (12h39m5.794706254s) [upload=13026]: Done uploading segments... Aug 7 22:18:44.050671176 (12h39m5.794728026s) [upload=13026]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:08.682705115 (12h39m30.42676198s) [upload=13039]: Starting upload Aug 7 22:19:08.682797967 (12h39m30.426854836s) [upload=13039]: Done starting upload Aug 7 22:19:08.682924116 (12h39m30.426980968s) [upload=13039]: Uploading segments... Aug 7 22:19:08.682986486 (12h39m30.427043358s) [upload=13039]: Got next segment. Inline: true Aug 7 22:19:08.682993964 (12h39m30.427050856s) [upload=13039]: Waiting for error group managing segments... Aug 7 22:19:08.683054026 (12h39m30.427110894s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:08.683060373 (12h39m30.427117244s) [upload=13039]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:08.683064440 (12h39m30.42712131s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:38.406368834 (12h40m0.150425697s) [upload=13039]: Done uploading segments... Aug 7 22:19:38.406426692 (12h40m0.150483554s) [upload=13039]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:20.517418397 (12h40m42.26147525s) [upload=13053]: Starting upload Aug 7 22:20:20.517575991 (12h40m42.261632856s) [upload=13053]: Done starting upload Aug 7 22:20:20.517715190 (12h40m42.261772059s) [upload=13053]: Uploading segments... Aug 7 22:20:20.517901368 (12h40m42.26195823s) [upload=13053]: Got next segment. Inline: true Aug 7 22:20:20.517963476 (12h40m42.262020457s) [upload=13053]: Waiting for error group managing segments... Aug 7 22:20:20.518079988 (12h40m42.262137053s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:20.518123882 (12h40m42.262180743s) [upload=13053]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:20.518130819 (12h40m42.262187685s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:50.250392650 (12h41m11.994449511s) [upload=13053]: Done uploading segments... Aug 7 22:20:50.250418123 (12h41m11.994474984s) [upload=13053]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:21:32.413463521 (12h41m54.157520381s) [upload=13069]: Starting upload Aug 7 22:21:32.413532657 (12h41m54.157589509s) [upload=13069]: Done starting upload Aug 7 22:21:32.413608430 (12h41m54.157665281s) [upload=13069]: Uploading segments... Aug 7 22:21:32.413661653 (12h41m54.157718517s) [upload=13069]: Got next segment. Inline: true Aug 7 22:21:32.413666698 (12h41m54.157723558s) [upload=13069]: Waiting for error group managing segments... Aug 7 22:21:32.413708373 (12h41m54.157765222s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:21:32.413713536 (12h41m54.157770396s) [upload=13069]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:21:32.413727266 (12h41m54.157784127s) [upload=13069]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:22:02.144247861 (12h42m23.888304727s) [upload=13069]: Done uploading segments... Aug 7 22:22:02.144276519 (12h42m23.888333383s) [upload=13069]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.003396726s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [X..................................................X........] duration: 112.292438ms remote: "tcp:185.244.226.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 22:22:02 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 112.322713ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXX......X................................X.XXXXXXXXX] duration: 1m0.00144768s FAIL (2025-08-07 22:21:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Aug 7 22:11:35.297686234 (12h31m57.041743086s) [upload=12923]: Uploading segments... Aug 7 22:11:35.297779680 (12h31m57.041836543s) [upload=12923]: Got next segment. Inline: true Aug 7 22:11:35.297790270 (12h31m57.041847121s) [upload=12923]: Waiting for error group managing segments... Aug 7 22:11:35.297854321 (12h31m57.041911182s) [upload=12923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:11:35.297860387 (12h31m57.041917249s) [upload=12923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:11:35.297863885 (12h31m57.041920745s) [upload=12923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:11:44.558966532 (12h32m6.303023384s) [upload=12923]: Done uploading segments... Aug 7 22:11:44.558985310 (12h32m6.303042163s) [upload=12923]: Upload finished. err: <nil> Aug 7 22:12:36.559571434 (12h32m58.30362831s) [upload=12938]: Starting upload Aug 7 22:12:36.559699331 (12h32m58.3037562s) [upload=12938]: Done starting upload Aug 7 22:12:36.559803583 (12h32m58.30386044s) [upload=12938]: Uploading segments... Aug 7 22:12:36.560034082 (12h32m58.304090945s) [upload=12938]: Got next segment. Inline: true Aug 7 22:12:36.560041392 (12h32m58.304098252s) [upload=12938]: Waiting for error group managing segments... Aug 7 22:12:36.560151251 (12h32m58.304208113s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:12:36.560159993 (12h32m58.304216852s) [upload=12938]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:12:36.560164091 (12h32m58.304220952s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:36.275827133 (12h33m58.019883992s) [upload=12938]: Done uploading segments... Aug 7 22:13:36.275867976 (12h33m58.019924837s) [upload=12938]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:36.703916041 (12h33m58.447972892s) [upload=12954]: Starting upload Aug 7 22:13:36.704016678 (12h33m58.448073543s) [upload=12954]: Done starting upload Aug 7 22:13:36.704126028 (12h33m58.448182877s) [upload=12954]: Uploading segments... Aug 7 22:13:36.704202003 (12h33m58.448258875s) [upload=12954]: Got next segment. Inline: true Aug 7 22:13:36.704208724 (12h33m58.448265583s) [upload=12954]: Waiting for error group managing segments... Aug 7 22:13:36.704253077 (12h33m58.44830994s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:36.704259505 (12h33m58.448316353s) [upload=12954]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:36.704263329 (12h33m58.448320184s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:36.426520849 (12h34m58.170577716s) [upload=12954]: Done uploading segments... Aug 7 22:14:36.426547324 (12h34m58.170604188s) [upload=12954]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:36.851362491 (12h34m58.595419352s) [upload=12969]: Starting upload Aug 7 22:14:36.851438058 (12h34m58.595494919s) [upload=12969]: Done starting upload Aug 7 22:14:36.851531336 (12h34m58.595588182s) [upload=12969]: Uploading segments... Aug 7 22:14:36.851620028 (12h34m58.595676898s) [upload=12969]: Got next segment. Inline: true Aug 7 22:14:36.851627191 (12h34m58.595684056s) [upload=12969]: Waiting for error group managing segments... Aug 7 22:14:36.851698724 (12h34m58.595755585s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:36.851706200 (12h34m58.595763081s) [upload=12969]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:36.851710849 (12h34m58.595767717s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:36.582802839 (12h35m58.326859693s) [upload=12969]: Done uploading segments... Aug 7 22:15:36.582825807 (12h35m58.326882658s) [upload=12969]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:37.013505363 (12h35m58.757562231s) [upload=12985]: Starting upload Aug 7 22:15:37.013605304 (12h35m58.757662168s) [upload=12985]: Done starting upload Aug 7 22:15:37.013715315 (12h35m58.757772164s) [upload=12985]: Uploading segments... Aug 7 22:15:37.013761212 (12h35m58.757818081s) [upload=12985]: Got next segment. Inline: true Aug 7 22:15:37.013776983 (12h35m58.757833843s) [upload=12985]: Waiting for error group managing segments... Aug 7 22:15:37.013820691 (12h35m58.757877552s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:37.013826603 (12h35m58.757883467s) [upload=12985]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:37.013830513 (12h35m58.757887374s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:36.733288222 (12h36m58.477345085s) [upload=12985]: Done uploading segments... Aug 7 22:16:36.733314893 (12h36m58.477371754s) [upload=12985]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:37.187949023 (12h36m58.932005874s) [upload=13003]: Starting upload Aug 7 22:16:37.188024595 (12h36m58.932081456s) [upload=13003]: Done starting upload Aug 7 22:16:37.188115827 (12h36m58.932172677s) [upload=13003]: Uploading segments... Aug 7 22:16:37.188173315 (12h36m58.932230182s) [upload=13003]: Got next segment. Inline: true Aug 7 22:16:37.188181498 (12h36m58.932238365s) [upload=13003]: Waiting for error group managing segments... Aug 7 22:16:37.188252566 (12h36m58.932309427s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:37.188260045 (12h36m58.932316913s) [upload=13003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:37.188263607 (12h36m58.932320469s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:36.907306861 (12h37m58.651363739s) [upload=13003]: Done uploading segments... Aug 7 22:17:36.907340408 (12h37m58.651397275s) [upload=13003]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:46.749223731 (12h38m8.493280581s) [upload=13019]: Starting upload Aug 7 22:17:46.749288163 (12h38m8.493345017s) [upload=13019]: Done starting upload Aug 7 22:17:46.749381044 (12h38m8.493437894s) [upload=13019]: Uploading segments... Aug 7 22:17:46.749423663 (12h38m8.493480532s) [upload=13019]: Got next segment. Inline: true Aug 7 22:17:46.749428712 (12h38m8.493485573s) [upload=13019]: Waiting for error group managing segments... Aug 7 22:17:46.749471140 (12h38m8.49352799s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:46.749476259 (12h38m8.493533119s) [upload=13019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:46.749479952 (12h38m8.493536802s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:46.471549080 (12h39m8.215605941s) [upload=13019]: Done uploading segments... Aug 7 22:18:46.471571547 (12h39m8.215628407s) [upload=13019]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:46.904761993 (12h39m8.648818857s) [upload=13033]: Starting upload Aug 7 22:18:46.904856076 (12h39m8.648912937s) [upload=13033]: Done starting upload Aug 7 22:18:46.904960146 (12h39m8.649017s) [upload=13033]: Uploading segments... Aug 7 22:18:46.905047245 (12h39m8.649104114s) [upload=13033]: Got next segment. Inline: true Aug 7 22:18:46.905056198 (12h39m8.649113053s) [upload=13033]: Waiting for error group managing segments... Aug 7 22:18:46.905116687 (12h39m8.649173538s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:46.905122460 (12h39m8.649179309s) [upload=13033]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:46.905126367 (12h39m8.649183281s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:46.626010888 (12h40m8.370067739s) [upload=13033]: Done uploading segments... Aug 7 22:19:46.626032620 (12h40m8.370089471s) [upload=13033]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:59.643579230 (12h40m21.387636081s) [upload=13050]: Starting upload Aug 7 22:19:59.643668904 (12h40m21.387725771s) [upload=13050]: Done starting upload Aug 7 22:19:59.643785033 (12h40m21.38784188s) [upload=13050]: Uploading segments... Aug 7 22:19:59.643889787 (12h40m21.387946639s) [upload=13050]: Got next segment. Inline: true Aug 7 22:19:59.643897379 (12h40m21.387954229s) [upload=13050]: Waiting for error group managing segments... Aug 7 22:19:59.643957450 (12h40m21.388014313s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:59.643962932 (12h40m21.388019793s) [upload=13050]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:59.643966291 (12h40m21.388023151s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:59.369875577 (12h41m21.113932442s) [upload=13050]: Done uploading segments... Aug 7 22:20:59.369905671 (12h41m21.113962518s) [upload=13050]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:59.787948456 (12h41m21.532005324s) [upload=13064]: Starting upload Aug 7 22:20:59.788068842 (12h41m21.53212571s) [upload=13064]: Done starting upload Aug 7 22:20:59.788168587 (12h41m21.532225457s) [upload=13064]: Uploading segments... Aug 7 22:20:59.788311286 (12h41m21.532368151s) [upload=13064]: Got next segment. Inline: true Aug 7 22:20:59.788318759 (12h41m21.532375633s) [upload=13064]: Waiting for error group managing segments... Aug 7 22:20:59.788388410 (12h41m21.532445276s) [upload=13064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:59.788394823 (12h41m21.532451689s) [upload=13064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:59.788398689 (12h41m21.532455554s) [upload=13064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:21:59.519361969 (12h42m21.263418825s) [upload=13064]: Done uploading segments... Aug 7 22:21:59.519387607 (12h42m21.263444468s) [upload=13064]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.001467544s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [XXXXX.X..........................................XXXXXXXXXXX] duration: 30.001165306s FAIL (2025-08-07 22:21:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001199261s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X...X..........................X.] duration: 845.507927ms FAIL (2025-08-07 22:21:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== oad=12946]: Done uploading segments... Aug 7 22:13:06.973788967 (12h33m28.717845817s) [upload=12946]: Upload finished. err: <nil> Aug 7 22:13:30.021513352 (12h33m51.765570214s) [upload=12952]: Starting upload Aug 7 22:13:30.021593609 (12h33m51.76565047s) [upload=12952]: Done starting upload Aug 7 22:13:30.021654614 (12h33m51.765711463s) [upload=12952]: Uploading segments... Aug 7 22:13:30.021737458 (12h33m51.765794327s) [upload=12952]: Got next segment. Inline: true Aug 7 22:13:30.021744385 (12h33m51.765801246s) [upload=12952]: Waiting for error group managing segments... Aug 7 22:13:30.021806243 (12h33m51.765863106s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:30.021811954 (12h33m51.765868813s) [upload=12952]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:30.021815203 (12h33m51.765872063s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:30.450767059 (12h33m52.194823912s) [upload=12952]: Done uploading segments... Aug 7 22:13:30.450786964 (12h33m52.194843815s) [upload=12952]: Upload finished. err: <nil> Aug 7 22:14:24.441642672 (12h34m46.185699519s) [upload=12964]: Starting upload Aug 7 22:14:24.441731987 (12h34m46.185788849s) [upload=12964]: Done starting upload Aug 7 22:14:24.441844223 (12h34m46.185901069s) [upload=12964]: Uploading segments... Aug 7 22:14:24.441952356 (12h34m46.186009238s) [upload=12964]: Got next segment. Inline: true Aug 7 22:14:24.441960404 (12h34m46.186017265s) [upload=12964]: Waiting for error group managing segments... Aug 7 22:14:24.442032277 (12h34m46.186089141s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:24.442038920 (12h34m46.186095769s) [upload=12964]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:24.442045324 (12h34m46.186102193s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:24.691130502 (12h34m46.435187353s) [upload=12964]: Done uploading segments... Aug 7 22:14:24.691168009 (12h34m46.435224859s) [upload=12964]: Upload finished. err: <nil> Aug 7 22:14:52.288782940 (12h35m14.032839801s) [upload=12974]: Starting upload Aug 7 22:14:52.288924660 (12h35m14.032981562s) [upload=12974]: Done starting upload Aug 7 22:14:52.288991726 (12h35m14.033048572s) [upload=12974]: Uploading segments... Aug 7 22:14:52.289071270 (12h35m14.033128145s) [upload=12974]: Got next segment. Inline: true Aug 7 22:14:52.289078867 (12h35m14.033135735s) [upload=12974]: Waiting for error group managing segments... Aug 7 22:14:52.289164039 (12h35m14.0332209s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:52.289171651 (12h35m14.033228513s) [upload=12974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:52.289176583 (12h35m14.033233444s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:52.452595224 (12h35m14.196652085s) [upload=12974]: Done uploading segments... Aug 7 22:14:52.452614952 (12h35m14.196671802s) [upload=12974]: Upload finished. err: <nil> Aug 7 22:15:58.755852650 (12h36m20.499909522s) [upload=12993]: Starting upload Aug 7 22:15:58.755930601 (12h36m20.499987455s) [upload=12993]: Done starting upload Aug 7 22:15:58.756035921 (12h36m20.500092782s) [upload=12993]: Uploading segments... Aug 7 22:15:58.756122656 (12h36m20.500179529s) [upload=12993]: Got next segment. Inline: true Aug 7 22:15:58.756129927 (12h36m20.500186799s) [upload=12993]: Waiting for error group managing segments... Aug 7 22:15:58.756200897 (12h36m20.500257762s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:58.756207605 (12h36m20.500264472s) [upload=12993]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:58.756211651 (12h36m20.500268513s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:58.903437708 (12h36m20.647494557s) [upload=12993]: Done uploading segments... Aug 7 22:15:58.903462384 (12h36m20.647519231s) [upload=12993]: Upload finished. err: <nil> Aug 7 22:16:15.337485833 (12h36m37.081542697s) [upload=12998]: Starting upload Aug 7 22:16:15.337573316 (12h36m37.081630164s) [upload=12998]: Done starting upload Aug 7 22:16:15.337667907 (12h36m37.081724797s) [upload=12998]: Uploading segments... Aug 7 22:16:15.337814382 (12h36m37.081871252s) [upload=12998]: Got next segment. Inline: true Aug 7 22:16:15.337826053 (12h36m37.081882921s) [upload=12998]: Waiting for error group managing segments... Aug 7 22:16:15.337898669 (12h36m37.08195553s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.337905734 (12h36m37.081962605s) [upload=12998]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.337934067 (12h36m37.081990931s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.509139020 (12h36m37.253195886s) [upload=12998]: Done uploading segments... Aug 7 22:16:15.509165009 (12h36m37.253221873s) [upload=12998]: Upload finished. err: <nil> Aug 7 22:16:46.696796765 (12h37m8.440853615s) [upload=13006]: Starting upload Aug 7 22:16:46.696851500 (12h37m8.440908351s) [upload=13006]: Done starting upload Aug 7 22:16:46.696919178 (12h37m8.44097604s) [upload=13006]: Uploading segments... Aug 7 22:16:46.696965400 (12h37m8.441022269s) [upload=13006]: Got next segment. Inline: true Aug 7 22:16:46.696970111 (12h37m8.441026962s) [upload=13006]: Waiting for error group managing segments... Aug 7 22:16:46.697010995 (12h37m8.441067847s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:46.697016018 (12h37m8.441072868s) [upload=13006]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:46.697019675 (12h37m8.44107653s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:46.874265238 (12h37m8.618322106s) [upload=13006]: Done uploading segments... Aug 7 22:16:46.874318422 (12h37m8.618375284s) [upload=13006]: Upload finished. err: <nil> Aug 7 22:17:54.674081400 (12h38m16.418138249s) [upload=13021]: Starting upload Aug 7 22:17:54.674159403 (12h38m16.418216253s) [upload=13021]: Done starting upload Aug 7 22:17:54.674269670 (12h38m16.418326517s) [upload=13021]: Uploading segments... Aug 7 22:17:54.674363154 (12h38m16.418420014s) [upload=13021]: Got next segment. Inline: true Aug 7 22:17:54.674369843 (12h38m16.418426703s) [upload=13021]: Waiting for error group managing segments... Aug 7 22:17:54.674442390 (12h38m16.418499251s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:54.674447948 (12h38m16.418504799s) [upload=13021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:54.674451453 (12h38m16.418508313s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:54.827409307 (12h38m16.571466155s) [upload=13021]: Done uploading segments... Aug 7 22:17:54.827433528 (12h38m16.571490374s) [upload=13021]: Upload finished. err: <nil> Aug 7 22:19:01.440458592 (12h39m23.184515453s) [upload=13036]: Starting upload Aug 7 22:19:01.440570182 (12h39m23.184627051s) [upload=13036]: Done starting upload Aug 7 22:19:01.440699423 (12h39m23.184756285s) [upload=13036]: Uploading segments... Aug 7 22:19:01.440794556 (12h39m23.184851411s) [upload=13036]: Got next segment. Inline: true Aug 7 22:19:01.440803141 (12h39m23.184860002s) [upload=13036]: Waiting for error group managing segments... Aug 7 22:19:01.440879672 (12h39m23.184936519s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:01.440886345 (12h39m23.184943191s) [upload=13036]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:01.440890294 (12h39m23.184947158s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:01.709467042 (12h39m23.45352391s) [upload=13036]: Done uploading segments... Aug 7 22:19:01.709491674 (12h39m23.453548536s) [upload=13036]: Upload finished. err: <nil> Aug 7 22:19:45.253186247 (12h40m6.997243094s) [upload=13047]: Starting upload Aug 7 22:19:45.253237927 (12h40m6.997294773s) [upload=13047]: Done starting upload Aug 7 22:19:45.253295065 (12h40m6.997351912s) [upload=13047]: Uploading segments... Aug 7 22:19:45.253376256 (12h40m6.997433124s) [upload=13047]: Got next segment. Inline: true Aug 7 22:19:45.253382535 (12h40m6.997439396s) [upload=13047]: Waiting for error group managing segments... Aug 7 22:19:45.253441431 (12h40m6.997498291s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:45.253446448 (12h40m6.997503294s) [upload=13047]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:45.253449347 (12h40m6.997506208s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:45.480979982 (12h40m7.225036832s) [upload=13047]: Done uploading segments... Aug 7 22:19:45.480999304 (12h40m7.22505615s) [upload=13047]: Upload finished. err: <nil> Aug 7 22:20:54.671307886 (12h41m16.415364754s) [upload=13061]: Starting upload Aug 7 22:20:54.671398239 (12h41m16.41545511s) [upload=13061]: Done starting upload Aug 7 22:20:54.671491892 (12h41m16.415548958s) [upload=13061]: Uploading segments... Aug 7 22:20:54.671578785 (12h41m16.415635652s) [upload=13061]: Got next segment. Inline: true Aug 7 22:20:54.671585361 (12h41m16.415642224s) [upload=13061]: Waiting for error group managing segments... Aug 7 22:20:54.671656504 (12h41m16.415713357s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:54.671670437 (12h41m16.415727303s) [upload=13061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:54.671692679 (12h41m16.415749544s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:54.840367361 (12h41m16.584424221s) [upload=13061]: Done uploading segments... Aug 7 22:20:54.840387040 (12h41m16.5844439s) [upload=13061]: Upload finished. err: <nil> Duration: 845.533938ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.....................................XXXXXXXXXXX] duration: 30.000541534s FAIL (2025-08-07 22:21:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000571694s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [.X..................................................X.......] duration: 112.652054ms remote: "tcp:185.244.226.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 22:21:36 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 112.681922ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 26 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX......X.X...........................XXXXXXXXXX] duration: 1m0.001445129s FAIL (2025-08-07 22:21:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001463067s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 22 out of 60 is failed (threshold=3) [XXXXX..X.XX..................................X.XXXXXXXXXXXXX] duration: 30.001153125s FAIL (2025-08-07 22:21:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001169634s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [......XX.X................................................XX] duration: 2m0.000897632s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 22:21:20 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.000914942s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 11 out of 60 is failed (threshold=3) [...................XXXX..............................XXXXXXX] duration: 1m0.000908816s FAIL (2025-08-07 22:21:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== (12h32m18.925025749s) [noise=true , address=104.36.82.45:4940 , piece_id=E2BSUMWRGNFOCNBBT32GAMW3JN4PFKNKSYXK5AEUGQQKRK4I6FKA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.182573730 (12h32m18.926630601s) [noise=true , address=104.36.82.43:4837 , piece_id=WALP4A6IL6VR6577XHAIATXZGBECNO6BL5Y5Z4I4DMPCNIK7X5QQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.185217873 (12h32m18.929274727s) [noise=true , address=104.36.82.60:4346 , piece_id=OCI6XALWGEOAF64WRNURL5VVPFWYBT24GXK4GNQMUX2MJYZACROQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.191081154 (12h32m18.935138022s) [noise=true , address=104.36.82.23:4448 , piece_id=RD4YTZPX2A4SRE2XWYS45DWZRG6CUS5VLCYBMJPBJ24LGJTGITFQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.205956300 (12h32m18.950013175s) [noise=true , address=104.36.82.36:4645 , piece_id=P63BF2T4FLUK7DMM4GQY277QTDGZXT3CD4Z5GFDMUQTTJN77TZIQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.214668342 (12h32m18.958725212s) [noise=true , address=104.36.82.39:4733 , piece_id=VZPW75CLRYOWCVQGWBWAOGWKFCXYLYOM6OIDMXRBR5IRGZ7DGLLQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.245950582 (12h32m18.990007453s) [noise=true , address=104.36.82.16:4310 , piece_id=UAVZCLFOGCC6T4HX676IX6OWFNRZRTXL3PITG5IZFR2JATIZS2DQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.280359350 (12h32m19.024416213s) [noise=true , address=45.91.116.9:4272 , piece_id=3QGHJZTVECLQTJGC46GZ5276LVTHR36LBTK5Q5FSRGD7QXOUJJ6A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.338710901 (12h32m19.082767752s) [noise=true , address=45.91.116.13:4166 , piece_id=HSFXWLME6GIFAWHD73GW4H6CBPBJZ4MPTB7JD7XY2YBTZESICNRA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.617684582 (12h32m19.361741428s) [noise=true , address=104.36.82.62:4439 , piece_id=2P7NHL5WLDREVBGDS4IMRS6D4DZBQHRYFM7USCDK2KU74SKDLW4A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.617723267 (12h32m19.361780128s) [seg_pos={0 0}, upload=12925]: Segment reached optimal threshold of 14 pieces. Aug 7 22:11:57.617992734 (12h32m19.36204958s) [noise=true , address=104.36.82.47:4520 , piece_id=DLEDG3JMSGGGFQFGNJWV4XIDPXITG54XCYTRXXJIRR4DOXWIDAVA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618089635 (12h32m19.362146495s) [noise=true , address=64.49.13.137:4498 , piece_id=7SLUBM4U2CKK25FCFPHVKBA4D4TKCRZXKASC7LR2ASBM7C7MDQKQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nh2t6FxdqbwMky99pfMDNcGXozoMYn4euWvNtThnoTvPMbpS5): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618135706 (12h32m19.362192556s) [noise=true , address=104.36.82.5:4855 , piece_id=OEDGYJGQIIJHLEBR5OPPQCO75KXIGPFZBDCCTBYSUV7XQADJRSAA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection Aug 7 22:11:57.618165938 (12h32m19.362222785s) [noise=true , address=64.49.13.139:4471 , piece_id=QTORROJDLNZQTDC2VFU3Q5DW47TA7VM7FZAVKTACLLCPMHGOC52A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618181168 (12h32m19.362238028s) [seg_pos={0 0}, upload=12925]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:11:57.618262981 (12h32m19.362319833s) [upload=12925]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:11:57.618268565 (12h32m19.362325425s) [upload=12925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:11.462898274 (12h35m33.206955137s) [upload=12925]: Done uploading segments... Aug 7 22:15:11.462927061 (12h35m33.206983911s) [upload=12925]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:11.893865947 (12h35m33.637922798s) [upload=12978]: Starting upload Aug 7 22:15:11.894006161 (12h35m33.638063025s) [upload=12978]: Done starting upload Aug 7 22:15:11.894128456 (12h35m33.63818531s) [upload=12978]: Uploading segments... Aug 7 22:15:11.894439225 (12h35m33.638496094s) [upload=12978]: Got next segment. Inline: false Aug 7 22:15:11.894516777 (12h35m33.638573639s) [upload=12978]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:11.894545833 (12h35m33.638602694s) [upload=12978]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:16:11.626077800 (12h36m33.370134666s) [upload=12978]: Next segment err: context deadline exceeded Aug 7 22:16:11.626165441 (12h36m33.370222301s) [upload=12978]: Done uploading segments... Aug 7 22:16:11.626183066 (12h36m33.370239913s) [upload=12978]: Upload finished. err: context deadline exceeded Aug 7 22:16:12.058909015 (12h36m33.802965875s) [upload=12997]: Starting upload Aug 7 22:16:12.058982372 (12h36m33.803039232s) [upload=12997]: Done starting upload Aug 7 22:16:12.059120653 (12h36m33.803177509s) [upload=12997]: Uploading segments... Aug 7 22:16:12.059593126 (12h36m33.803649985s) [upload=12997]: Got next segment. Inline: false Aug 7 22:16:12.059677172 (12h36m33.803734023s) [upload=12997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:12.059684424 (12h36m33.803741287s) [upload=12997]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:17:11.787443939 (12h37m33.531500809s) [upload=12997]: Next segment err: context deadline exceeded Aug 7 22:17:11.787498695 (12h37m33.531555556s) [upload=12997]: Done uploading segments... Aug 7 22:17:11.787527052 (12h37m33.531583904s) [upload=12997]: Upload finished. err: context deadline exceeded Aug 7 22:17:12.226578214 (12h37m33.970635065s) [upload=13013]: Starting upload Aug 7 22:17:12.226666960 (12h37m33.970723825s) [upload=13013]: Done starting upload Aug 7 22:17:12.226793229 (12h37m33.970850079s) [upload=13013]: Uploading segments... Aug 7 22:17:12.227044345 (12h37m33.971101196s) [upload=13013]: Got next segment. Inline: false Aug 7 22:17:12.227107713 (12h37m33.971164563s) [upload=13013]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:12.227113591 (12h37m33.971170444s) [upload=13013]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:18:11.956251664 (12h38m33.700308534s) [upload=13013]: Next segment err: context deadline exceeded Aug 7 22:18:11.956360027 (12h38m33.700416877s) [upload=13013]: Done uploading segments... Aug 7 22:18:11.956379323 (12h38m33.700436185s) [upload=13013]: Upload finished. err: context deadline exceeded Aug 7 22:18:12.371524537 (12h38m34.115581388s) [upload=13024]: Starting upload Aug 7 22:18:12.371599713 (12h38m34.115656573s) [upload=13024]: Done starting upload Aug 7 22:18:12.371686548 (12h38m34.115743409s) [upload=13024]: Uploading segments... Aug 7 22:18:12.371885224 (12h38m34.115942074s) [upload=13024]: Got next segment. Inline: false Aug 7 22:18:12.371926111 (12h38m34.115982962s) [upload=13024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:12.371931665 (12h38m34.115988525s) [upload=13024]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:19:12.105017725 (12h39m33.849074594s) [upload=13024]: Next segment err: context deadline exceeded Aug 7 22:19:12.105111880 (12h39m33.849168731s) [upload=13024]: Done uploading segments... Aug 7 22:19:12.105162034 (12h39m33.849218885s) [upload=13024]: Upload finished. err: context deadline exceeded Aug 7 22:19:14.319119032 (12h39m36.063175896s) [upload=13040]: Starting upload Aug 7 22:19:14.319296351 (12h39m36.063353203s) [upload=13040]: Done starting upload Aug 7 22:19:14.319413921 (12h39m36.063470785s) [upload=13040]: Uploading segments... Aug 7 22:19:14.319749644 (12h39m36.063806505s) [upload=13040]: Got next segment. Inline: false Aug 7 22:19:14.319821004 (12h39m36.063877869s) [upload=13040]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:14.319827454 (12h39m36.063884319s) [upload=13040]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:20:14.045204095 (12h40m35.789261177s) [upload=13040]: Next segment err: context deadline exceeded Aug 7 22:20:14.045278008 (12h40m35.789334861s) [upload=13040]: Done uploading segments... Aug 7 22:20:14.045305281 (12h40m35.789362135s) [upload=13040]: Upload finished. err: context deadline exceeded Aug 7 22:20:14.488947199 (12h40m36.233004052s) [upload=13052]: Starting upload Aug 7 22:20:14.489008204 (12h40m36.233065065s) [upload=13052]: Done starting upload Aug 7 22:20:14.489081685 (12h40m36.233138549s) [upload=13052]: Uploading segments... Aug 7 22:20:14.489334590 (12h40m36.233391464s) [upload=13052]: Got next segment. Inline: false Aug 7 22:20:14.489475017 (12h40m36.233531868s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:14.489482865 (12h40m36.233539726s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:21:14.213984932 (12h41m35.958041781s) [upload=13052]: Next segment err: context deadline exceeded Aug 7 22:21:14.214010317 (12h41m35.958067177s) [upload=13052]: Done uploading segments... Aug 7 22:21:14.214041197 (12h41m35.958098044s) [upload=13052]: Upload finished. err: context deadline exceeded Duration: 1m0.000921903s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 109.166132ms remote: "tcp:185.244.226.2:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-07 22:21:14 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 109.200932ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.....X.........X..X...........X...................] duration: 3.682923195s FAIL (2025-08-07 22:21:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 5.727759364s) [upload=12820]: Starting upload Aug 7 22:05:23.983754833 (12h25m45.727811679s) [upload=12820]: Done starting upload Aug 7 22:05:23.983988533 (12h25m45.728045379s) [upload=12820]: Uploading segments... Aug 7 22:05:23.984022348 (12h25m45.728079214s) [upload=12820]: Got next segment. Inline: false Aug 7 22:05:23.984055700 (12h25m45.728112548s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:05:23.984060538 (12h25m45.728117398s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:05:24.185392691 (12h25m45.929449561s) [seg_pos={0 0}, upload=12820]: Begin upload segment... Aug 7 22:05:24.185557956 (12h25m45.929614817s) [seg_pos={0 0}, upload=12820]: Done begin upload segment. Aug 7 22:05:24.185603301 (12h25m45.929660177s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186037040 (12h25m45.930093906s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186570414 (12h25m45.930627287s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.186824559 (12h25m45.930881425s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187208122 (12h25m45.931264991s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187658761 (12h25m45.931715627s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.187940002 (12h25m45.931996872s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188116203 (12h25m45.932173069s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188531115 (12h25m45.932587976s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188637273 (12h25m45.932694145s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.188961006 (12h25m45.933017872s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189183712 (12h25m45.933240578s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189352560 (12h25m45.933409422s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189640677 (12h25m45.93369755s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.189855650 (12h25m45.933912517s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190187162 (12h25m45.934244033s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190334028 (12h25m45.934390898s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.190661949 (12h25m45.934718816s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Uploading piece... Aug 7 22:05:24.754845434 (12h25m46.498902284s) [upload=12820]: Next returned nil segment Aug 7 22:05:24.754862619 (12h25m46.49891948s) [upload=12820]: Waiting for error group managing segments... Aug 7 22:05:24.937656798 (12h25m46.681713649s) [noise=true , address=45.91.116.6:4982 , piece_id=LAWUMX2HZNNHRQ3FUODV65COBDIMOZN2HBCSPD42P5DEC4N4VABQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.980443483 (12h25m46.724500333s) [noise=true , address=104.36.82.12:4174 , piece_id=DCAYU4CKMHLHOHAN7MKLV5KJTRCCC2IOWSPFPWEMAU3FSIVIXRQA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:24.995491860 (12h25m46.739551452s) [noise=true , address=77.90.31.16:4742 , piece_id=5USKIHBGUAV6G3BX5BHC6LOEEHDNAJUFK45RWH6OC25QGOMH7V4Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.083772095 (12h25m46.827828964s) [noise=true , address=104.36.82.46:4496 , piece_id=XNRPMJSQ3BNIILAQDMRYLFM623WHRZ63ND4RDTHJYLSWWOPNJGHA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.147179204 (12h25m46.891236066s) [noise=true , address=104.36.82.13:4201 , piece_id=PD7C77UABKPFT2WM7BOTNOGQV22DUPGWWOGZ5KUUMUVMWSSSHTJA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.274393636 (12h25m47.018450492s) [noise=true , address=104.36.82.62:4439 , piece_id=TQYPKEGJFIZ7D26GWFTFSU4PU75J5DX24QKUEEUUX66EINYJEMIQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.452784464 (12h25m47.196841314s) [noise=true , address=64.49.13.169:4705 , piece_id=6C45BITH3QWBJ22PLPILYA6LOUQ2JF2D2LOAL2BVJQQWXSXQ37IQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.474459740 (12h25m47.218516586s) [noise=true , address=64.49.13.26:4945 , piece_id=BODENY6IN5IS2I2RJ3J3EV3XYKZD4B4RR4PQNKSEXYXVUVYPMC6A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.481247102 (12h25m47.225303949s) [noise=true , address=64.49.13.140:4515 , piece_id=WQSSOLYXPIBGHNVEG5IWDPLM45QDWPATVU73OJJTRU7NJRQCHDKA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666066275 (12h25m47.410123138s) [noise=true , address=104.36.82.58:4292 , piece_id=RJJS3MVCC3B3RTAXEM3XLHRSWZEUKIJUSILSKJKT5LJCWNEHX5GA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.666429351 (12h25m47.410486202s) [noise=true , address=104.36.82.56:4233 , piece_id=ING27ZVSXOL6ASCWIVGSF2KESQ4N6O4AXGQ3HF5EZK5TZ5T3SNNQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.782101005 (12h25m47.526157853s) [noise=true , address=104.36.82.16:4314 , piece_id=KX4ZY5LSNB6YBYAS4NKW2QQXXQZV42VGR2TRRKZIL6ZIO3M7BAQQ, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.863469768 (12h25m47.607526622s) [noise=true , address=104.36.82.43:4868 , piece_id=QSDRGPBV3KWFHHKWJWKLJ3N5APRHOI66TTWAWNOJDCRXQU2P7PAA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865162168 (12h25m47.609219032s) [noise=true , address=104.36.82.60:4346 , piece_id=CJPTIG7EI264SA2JCH5326GTL33YW6ASGJPXO5ZRWRDD3L5BQTYA, seg_pos={0 0}, upload=12820]: Done uploading piece. err: <nil> Aug 7 22:05:25.865201343 (12h25m47.609258205s) [seg_pos={0 0}, upload=12820]: Segment reached optimal threshold of 14 pieces. Aug 7 22:05:25.865362755 (12h25m47.609419601s) [noise=true , address=104.36.82.47:4534 , piece_id=JS7S2OPLDOU5C52ZACTR77R2OVC56PBN6BDNGAPRBNN3UHXQPX3Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865412734 (12h25m47.609469599s) [noise=true , address=104.36.82.20:4461 , piece_id=XGB6IA7NPLFF7XKYATSOG54O7U36IX6BVHVWGA53T7MNVBFM5R2A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nhwT2THUu6ptumqU9Bz1Nd34FHLewx9vWjGFC34j3Lz3RWfkw): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865468394 (12h25m47.609525241s) [noise=true , address=104.36.82.5:4862 , piece_id=W6AHEAV5E5RQR3YQ3LFOO33URBFGYOVTT23S5JKPP7MDNIRFHV5Q, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sUT7LBYFqWMUhx7MMjEmyiFDnbJnjSVndNbTaHioaVLLSXYue): protocol: expected piece hash; context canceled; EOF Aug 7 22:05:25.865629517 (12h25m47.609686385s) [noise=true , address=104.36.82.22:4530 , piece_id=U33JUCE4QFPT54RRVY57EF64QS7C4TUO7MWOOGZFAIHBZQUZFB3A, seg_pos={0 0}, upload=12820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1akHUSoQFafzkGTJ385iYaowc87pJBDNfU5hodSCUDFa5ojN3v): protocol: write tcp 139.59.144.22:45386->104.36.82.22:4530: use of closed network connection; context canceled Aug 7 22:05:25.865657252 (12h25m47.609714121s) [seg_pos={0 0}, upload=12820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:05:25.865814825 (12h25m47.609871688s) [upload=12820]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:05:25.865822925 (12h25m47.609879795s) [upload=12820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:05:26.138690358 (12h25m47.882747231s) [upload=12820]: Done uploading segments... Aug 7 22:05:26.138713087 (12h25m47.882769948s) [upload=12820]: Upload finished. err: <nil> Duration: 3.682954655s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXX......X................................X.XXXXXXXX] duration: 1m0.001852696s FAIL (2025-08-07 22:20:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== g upload Aug 7 22:10:28.314903941 (12h30m50.058960802s) [upload=12903]: Uploading segments... Aug 7 22:10:28.314992884 (12h30m50.059049757s) [upload=12903]: Got next segment. Inline: true Aug 7 22:10:28.315015785 (12h30m50.059072647s) [upload=12903]: Waiting for error group managing segments... Aug 7 22:10:28.315072549 (12h30m50.059129415s) [upload=12903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:10:28.315079820 (12h30m50.059136685s) [upload=12903]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:10:28.315099592 (12h30m50.059156457s) [upload=12903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:11:28.039892681 (12h31m49.783949531s) [upload=12903]: Done uploading segments... Aug 7 22:11:28.039913432 (12h31m49.783970283s) [upload=12903]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:11:35.297516727 (12h31m57.041573588s) [upload=12923]: Starting upload Aug 7 22:11:35.297601596 (12h31m57.041658469s) [upload=12923]: Done starting upload Aug 7 22:11:35.297686234 (12h31m57.041743086s) [upload=12923]: Uploading segments... Aug 7 22:11:35.297779680 (12h31m57.041836543s) [upload=12923]: Got next segment. Inline: true Aug 7 22:11:35.297790270 (12h31m57.041847121s) [upload=12923]: Waiting for error group managing segments... Aug 7 22:11:35.297854321 (12h31m57.041911182s) [upload=12923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:11:35.297860387 (12h31m57.041917249s) [upload=12923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:11:35.297863885 (12h31m57.041920745s) [upload=12923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:11:44.558966532 (12h32m6.303023384s) [upload=12923]: Done uploading segments... Aug 7 22:11:44.558985310 (12h32m6.303042163s) [upload=12923]: Upload finished. err: <nil> Aug 7 22:12:36.559571434 (12h32m58.30362831s) [upload=12938]: Starting upload Aug 7 22:12:36.559699331 (12h32m58.3037562s) [upload=12938]: Done starting upload Aug 7 22:12:36.559803583 (12h32m58.30386044s) [upload=12938]: Uploading segments... Aug 7 22:12:36.560034082 (12h32m58.304090945s) [upload=12938]: Got next segment. Inline: true Aug 7 22:12:36.560041392 (12h32m58.304098252s) [upload=12938]: Waiting for error group managing segments... Aug 7 22:12:36.560151251 (12h32m58.304208113s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:12:36.560159993 (12h32m58.304216852s) [upload=12938]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:12:36.560164091 (12h32m58.304220952s) [upload=12938]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:36.275827133 (12h33m58.019883992s) [upload=12938]: Done uploading segments... Aug 7 22:13:36.275867976 (12h33m58.019924837s) [upload=12938]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:36.703916041 (12h33m58.447972892s) [upload=12954]: Starting upload Aug 7 22:13:36.704016678 (12h33m58.448073543s) [upload=12954]: Done starting upload Aug 7 22:13:36.704126028 (12h33m58.448182877s) [upload=12954]: Uploading segments... Aug 7 22:13:36.704202003 (12h33m58.448258875s) [upload=12954]: Got next segment. Inline: true Aug 7 22:13:36.704208724 (12h33m58.448265583s) [upload=12954]: Waiting for error group managing segments... Aug 7 22:13:36.704253077 (12h33m58.44830994s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:36.704259505 (12h33m58.448316353s) [upload=12954]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:36.704263329 (12h33m58.448320184s) [upload=12954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:36.426520849 (12h34m58.170577716s) [upload=12954]: Done uploading segments... Aug 7 22:14:36.426547324 (12h34m58.170604188s) [upload=12954]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:36.851362491 (12h34m58.595419352s) [upload=12969]: Starting upload Aug 7 22:14:36.851438058 (12h34m58.595494919s) [upload=12969]: Done starting upload Aug 7 22:14:36.851531336 (12h34m58.595588182s) [upload=12969]: Uploading segments... Aug 7 22:14:36.851620028 (12h34m58.595676898s) [upload=12969]: Got next segment. Inline: true Aug 7 22:14:36.851627191 (12h34m58.595684056s) [upload=12969]: Waiting for error group managing segments... Aug 7 22:14:36.851698724 (12h34m58.595755585s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:36.851706200 (12h34m58.595763081s) [upload=12969]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:36.851710849 (12h34m58.595767717s) [upload=12969]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:36.582802839 (12h35m58.326859693s) [upload=12969]: Done uploading segments... Aug 7 22:15:36.582825807 (12h35m58.326882658s) [upload=12969]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:37.013505363 (12h35m58.757562231s) [upload=12985]: Starting upload Aug 7 22:15:37.013605304 (12h35m58.757662168s) [upload=12985]: Done starting upload Aug 7 22:15:37.013715315 (12h35m58.757772164s) [upload=12985]: Uploading segments... Aug 7 22:15:37.013761212 (12h35m58.757818081s) [upload=12985]: Got next segment. Inline: true Aug 7 22:15:37.013776983 (12h35m58.757833843s) [upload=12985]: Waiting for error group managing segments... Aug 7 22:15:37.013820691 (12h35m58.757877552s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:37.013826603 (12h35m58.757883467s) [upload=12985]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:37.013830513 (12h35m58.757887374s) [upload=12985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:36.733288222 (12h36m58.477345085s) [upload=12985]: Done uploading segments... Aug 7 22:16:36.733314893 (12h36m58.477371754s) [upload=12985]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:37.187949023 (12h36m58.932005874s) [upload=13003]: Starting upload Aug 7 22:16:37.188024595 (12h36m58.932081456s) [upload=13003]: Done starting upload Aug 7 22:16:37.188115827 (12h36m58.932172677s) [upload=13003]: Uploading segments... Aug 7 22:16:37.188173315 (12h36m58.932230182s) [upload=13003]: Got next segment. Inline: true Aug 7 22:16:37.188181498 (12h36m58.932238365s) [upload=13003]: Waiting for error group managing segments... Aug 7 22:16:37.188252566 (12h36m58.932309427s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:37.188260045 (12h36m58.932316913s) [upload=13003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:37.188263607 (12h36m58.932320469s) [upload=13003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:36.907306861 (12h37m58.651363739s) [upload=13003]: Done uploading segments... Aug 7 22:17:36.907340408 (12h37m58.651397275s) [upload=13003]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:46.749223731 (12h38m8.493280581s) [upload=13019]: Starting upload Aug 7 22:17:46.749288163 (12h38m8.493345017s) [upload=13019]: Done starting upload Aug 7 22:17:46.749381044 (12h38m8.493437894s) [upload=13019]: Uploading segments... Aug 7 22:17:46.749423663 (12h38m8.493480532s) [upload=13019]: Got next segment. Inline: true Aug 7 22:17:46.749428712 (12h38m8.493485573s) [upload=13019]: Waiting for error group managing segments... Aug 7 22:17:46.749471140 (12h38m8.49352799s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:46.749476259 (12h38m8.493533119s) [upload=13019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:46.749479952 (12h38m8.493536802s) [upload=13019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:46.471549080 (12h39m8.215605941s) [upload=13019]: Done uploading segments... Aug 7 22:18:46.471571547 (12h39m8.215628407s) [upload=13019]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:46.904761993 (12h39m8.648818857s) [upload=13033]: Starting upload Aug 7 22:18:46.904856076 (12h39m8.648912937s) [upload=13033]: Done starting upload Aug 7 22:18:46.904960146 (12h39m8.649017s) [upload=13033]: Uploading segments... Aug 7 22:18:46.905047245 (12h39m8.649104114s) [upload=13033]: Got next segment. Inline: true Aug 7 22:18:46.905056198 (12h39m8.649113053s) [upload=13033]: Waiting for error group managing segments... Aug 7 22:18:46.905116687 (12h39m8.649173538s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:46.905122460 (12h39m8.649179309s) [upload=13033]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:46.905126367 (12h39m8.649183281s) [upload=13033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:46.626010888 (12h40m8.370067739s) [upload=13033]: Done uploading segments... Aug 7 22:19:46.626032620 (12h40m8.370089471s) [upload=13033]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:59.643579230 (12h40m21.387636081s) [upload=13050]: Starting upload Aug 7 22:19:59.643668904 (12h40m21.387725771s) [upload=13050]: Done starting upload Aug 7 22:19:59.643785033 (12h40m21.38784188s) [upload=13050]: Uploading segments... Aug 7 22:19:59.643889787 (12h40m21.387946639s) [upload=13050]: Got next segment. Inline: true Aug 7 22:19:59.643897379 (12h40m21.387954229s) [upload=13050]: Waiting for error group managing segments... Aug 7 22:19:59.643957450 (12h40m21.388014313s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:59.643962932 (12h40m21.388019793s) [upload=13050]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:59.643966291 (12h40m21.388023151s) [upload=13050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:59.369875577 (12h41m21.113932442s) [upload=13050]: Done uploading segments... Aug 7 22:20:59.369905671 (12h41m21.113962518s) [upload=13050]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.001885762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 22 out of 60 is failed (threshold=3) [XXXXXX..X.XX..................................X.XXXXXXXXXXXX] duration: 30.0006894s FAIL (2025-08-07 22:20:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000717105s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X...X..........................X] duration: 752.756555ms FAIL (2025-08-07 22:20:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== oad=12946]: Done uploading segments... Aug 7 22:13:06.973788967 (12h33m28.717845817s) [upload=12946]: Upload finished. err: <nil> Aug 7 22:13:30.021513352 (12h33m51.765570214s) [upload=12952]: Starting upload Aug 7 22:13:30.021593609 (12h33m51.76565047s) [upload=12952]: Done starting upload Aug 7 22:13:30.021654614 (12h33m51.765711463s) [upload=12952]: Uploading segments... Aug 7 22:13:30.021737458 (12h33m51.765794327s) [upload=12952]: Got next segment. Inline: true Aug 7 22:13:30.021744385 (12h33m51.765801246s) [upload=12952]: Waiting for error group managing segments... Aug 7 22:13:30.021806243 (12h33m51.765863106s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:30.021811954 (12h33m51.765868813s) [upload=12952]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:30.021815203 (12h33m51.765872063s) [upload=12952]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:30.450767059 (12h33m52.194823912s) [upload=12952]: Done uploading segments... Aug 7 22:13:30.450786964 (12h33m52.194843815s) [upload=12952]: Upload finished. err: <nil> Aug 7 22:14:24.441642672 (12h34m46.185699519s) [upload=12964]: Starting upload Aug 7 22:14:24.441731987 (12h34m46.185788849s) [upload=12964]: Done starting upload Aug 7 22:14:24.441844223 (12h34m46.185901069s) [upload=12964]: Uploading segments... Aug 7 22:14:24.441952356 (12h34m46.186009238s) [upload=12964]: Got next segment. Inline: true Aug 7 22:14:24.441960404 (12h34m46.186017265s) [upload=12964]: Waiting for error group managing segments... Aug 7 22:14:24.442032277 (12h34m46.186089141s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:24.442038920 (12h34m46.186095769s) [upload=12964]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:24.442045324 (12h34m46.186102193s) [upload=12964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:24.691130502 (12h34m46.435187353s) [upload=12964]: Done uploading segments... Aug 7 22:14:24.691168009 (12h34m46.435224859s) [upload=12964]: Upload finished. err: <nil> Aug 7 22:14:52.288782940 (12h35m14.032839801s) [upload=12974]: Starting upload Aug 7 22:14:52.288924660 (12h35m14.032981562s) [upload=12974]: Done starting upload Aug 7 22:14:52.288991726 (12h35m14.033048572s) [upload=12974]: Uploading segments... Aug 7 22:14:52.289071270 (12h35m14.033128145s) [upload=12974]: Got next segment. Inline: true Aug 7 22:14:52.289078867 (12h35m14.033135735s) [upload=12974]: Waiting for error group managing segments... Aug 7 22:14:52.289164039 (12h35m14.0332209s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:52.289171651 (12h35m14.033228513s) [upload=12974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:52.289176583 (12h35m14.033233444s) [upload=12974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:52.452595224 (12h35m14.196652085s) [upload=12974]: Done uploading segments... Aug 7 22:14:52.452614952 (12h35m14.196671802s) [upload=12974]: Upload finished. err: <nil> Aug 7 22:15:58.755852650 (12h36m20.499909522s) [upload=12993]: Starting upload Aug 7 22:15:58.755930601 (12h36m20.499987455s) [upload=12993]: Done starting upload Aug 7 22:15:58.756035921 (12h36m20.500092782s) [upload=12993]: Uploading segments... Aug 7 22:15:58.756122656 (12h36m20.500179529s) [upload=12993]: Got next segment. Inline: true Aug 7 22:15:58.756129927 (12h36m20.500186799s) [upload=12993]: Waiting for error group managing segments... Aug 7 22:15:58.756200897 (12h36m20.500257762s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:58.756207605 (12h36m20.500264472s) [upload=12993]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:58.756211651 (12h36m20.500268513s) [upload=12993]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:58.903437708 (12h36m20.647494557s) [upload=12993]: Done uploading segments... Aug 7 22:15:58.903462384 (12h36m20.647519231s) [upload=12993]: Upload finished. err: <nil> Aug 7 22:16:15.337485833 (12h36m37.081542697s) [upload=12998]: Starting upload Aug 7 22:16:15.337573316 (12h36m37.081630164s) [upload=12998]: Done starting upload Aug 7 22:16:15.337667907 (12h36m37.081724797s) [upload=12998]: Uploading segments... Aug 7 22:16:15.337814382 (12h36m37.081871252s) [upload=12998]: Got next segment. Inline: true Aug 7 22:16:15.337826053 (12h36m37.081882921s) [upload=12998]: Waiting for error group managing segments... Aug 7 22:16:15.337898669 (12h36m37.08195553s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.337905734 (12h36m37.081962605s) [upload=12998]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.337934067 (12h36m37.081990931s) [upload=12998]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.509139020 (12h36m37.253195886s) [upload=12998]: Done uploading segments... Aug 7 22:16:15.509165009 (12h36m37.253221873s) [upload=12998]: Upload finished. err: <nil> Aug 7 22:16:46.696796765 (12h37m8.440853615s) [upload=13006]: Starting upload Aug 7 22:16:46.696851500 (12h37m8.440908351s) [upload=13006]: Done starting upload Aug 7 22:16:46.696919178 (12h37m8.44097604s) [upload=13006]: Uploading segments... Aug 7 22:16:46.696965400 (12h37m8.441022269s) [upload=13006]: Got next segment. Inline: true Aug 7 22:16:46.696970111 (12h37m8.441026962s) [upload=13006]: Waiting for error group managing segments... Aug 7 22:16:46.697010995 (12h37m8.441067847s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:46.697016018 (12h37m8.441072868s) [upload=13006]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:46.697019675 (12h37m8.44107653s) [upload=13006]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:46.874265238 (12h37m8.618322106s) [upload=13006]: Done uploading segments... Aug 7 22:16:46.874318422 (12h37m8.618375284s) [upload=13006]: Upload finished. err: <nil> Aug 7 22:17:54.674081400 (12h38m16.418138249s) [upload=13021]: Starting upload Aug 7 22:17:54.674159403 (12h38m16.418216253s) [upload=13021]: Done starting upload Aug 7 22:17:54.674269670 (12h38m16.418326517s) [upload=13021]: Uploading segments... Aug 7 22:17:54.674363154 (12h38m16.418420014s) [upload=13021]: Got next segment. Inline: true Aug 7 22:17:54.674369843 (12h38m16.418426703s) [upload=13021]: Waiting for error group managing segments... Aug 7 22:17:54.674442390 (12h38m16.418499251s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:54.674447948 (12h38m16.418504799s) [upload=13021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:54.674451453 (12h38m16.418508313s) [upload=13021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:54.827409307 (12h38m16.571466155s) [upload=13021]: Done uploading segments... Aug 7 22:17:54.827433528 (12h38m16.571490374s) [upload=13021]: Upload finished. err: <nil> Aug 7 22:19:01.440458592 (12h39m23.184515453s) [upload=13036]: Starting upload Aug 7 22:19:01.440570182 (12h39m23.184627051s) [upload=13036]: Done starting upload Aug 7 22:19:01.440699423 (12h39m23.184756285s) [upload=13036]: Uploading segments... Aug 7 22:19:01.440794556 (12h39m23.184851411s) [upload=13036]: Got next segment. Inline: true Aug 7 22:19:01.440803141 (12h39m23.184860002s) [upload=13036]: Waiting for error group managing segments... Aug 7 22:19:01.440879672 (12h39m23.184936519s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:01.440886345 (12h39m23.184943191s) [upload=13036]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:01.440890294 (12h39m23.184947158s) [upload=13036]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:01.709467042 (12h39m23.45352391s) [upload=13036]: Done uploading segments... Aug 7 22:19:01.709491674 (12h39m23.453548536s) [upload=13036]: Upload finished. err: <nil> Aug 7 22:19:45.253186247 (12h40m6.997243094s) [upload=13047]: Starting upload Aug 7 22:19:45.253237927 (12h40m6.997294773s) [upload=13047]: Done starting upload Aug 7 22:19:45.253295065 (12h40m6.997351912s) [upload=13047]: Uploading segments... Aug 7 22:19:45.253376256 (12h40m6.997433124s) [upload=13047]: Got next segment. Inline: true Aug 7 22:19:45.253382535 (12h40m6.997439396s) [upload=13047]: Waiting for error group managing segments... Aug 7 22:19:45.253441431 (12h40m6.997498291s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:45.253446448 (12h40m6.997503294s) [upload=13047]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:45.253449347 (12h40m6.997506208s) [upload=13047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:45.480979982 (12h40m7.225036832s) [upload=13047]: Done uploading segments... Aug 7 22:19:45.480999304 (12h40m7.22505615s) [upload=13047]: Upload finished. err: <nil> Aug 7 22:20:54.671307886 (12h41m16.415364754s) [upload=13061]: Starting upload Aug 7 22:20:54.671398239 (12h41m16.41545511s) [upload=13061]: Done starting upload Aug 7 22:20:54.671491892 (12h41m16.415548958s) [upload=13061]: Uploading segments... Aug 7 22:20:54.671578785 (12h41m16.415635652s) [upload=13061]: Got next segment. Inline: true Aug 7 22:20:54.671585361 (12h41m16.415642224s) [upload=13061]: Waiting for error group managing segments... Aug 7 22:20:54.671656504 (12h41m16.415713357s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:54.671670437 (12h41m16.415727303s) [upload=13061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:54.671692679 (12h41m16.415749544s) [upload=13061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:54.840367361 (12h41m16.584424221s) [upload=13061]: Done uploading segments... Aug 7 22:20:54.840387040 (12h41m16.5844439s) [upload=13061]: Upload finished. err: <nil> Duration: 752.804593ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [XXXXXX.X..........................................XXXXXXXXXX] duration: 30.001064113s FAIL (2025-08-07 22:20:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001089485s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.....................................XXXXXXXXXX] duration: 30.000459313s FAIL (2025-08-07 22:20:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000476534s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX....................................XXXXXXXXXXX] duration: 30.000830462s FAIL (2025-08-07 22:20:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (12h32m40.92738489s) [upload=12933]: Uploading segments... Aug 7 22:12:19.183400189 (12h32m40.92745706s) [upload=12933]: Got next segment. Inline: true Aug 7 22:12:19.183407329 (12h32m40.927464177s) [upload=12933]: Waiting for error group managing segments... Aug 7 22:12:19.183479311 (12h32m40.927536158s) [upload=12933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:12:19.183484643 (12h32m40.927541506s) [upload=12933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:12:19.183487379 (12h32m40.927544225s) [upload=12933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:12:48.909423390 (12h33m10.653480257s) [upload=12933]: Done uploading segments... Aug 7 22:12:48.909444894 (12h33m10.653501768s) [upload=12933]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:10.831892676 (12h33m32.575949525s) [upload=12948]: Starting upload Aug 7 22:13:10.831993207 (12h33m32.576050068s) [upload=12948]: Done starting upload Aug 7 22:13:10.832071605 (12h33m32.576128457s) [upload=12948]: Uploading segments... Aug 7 22:13:10.832146431 (12h33m32.576203291s) [upload=12948]: Got next segment. Inline: true Aug 7 22:13:10.832152814 (12h33m32.576209674s) [upload=12948]: Waiting for error group managing segments... Aug 7 22:13:10.832208966 (12h33m32.576265827s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:10.832214384 (12h33m32.576271244s) [upload=12948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:10.832217904 (12h33m32.576274764s) [upload=12948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:13:40.559928781 (12h34m2.303985629s) [upload=12948]: Done uploading segments... Aug 7 22:13:40.559950271 (12h34m2.304007117s) [upload=12948]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:13:48.685772427 (12h34m10.429829287s) [upload=12958]: Starting upload Aug 7 22:13:48.685858893 (12h34m10.429915753s) [upload=12958]: Done starting upload Aug 7 22:13:48.685982193 (12h34m10.430039042s) [upload=12958]: Uploading segments... Aug 7 22:13:48.686047966 (12h34m10.430104835s) [upload=12958]: Got next segment. Inline: true Aug 7 22:13:48.686053563 (12h34m10.430110423s) [upload=12958]: Waiting for error group managing segments... Aug 7 22:13:48.686096300 (12h34m10.43015316s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:13:48.686101341 (12h34m10.430158201s) [upload=12958]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:13:48.686104243 (12h34m10.430161104s) [upload=12958]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:14:18.399606594 (12h34m40.143663447s) [upload=12958]: Done uploading segments... Aug 7 22:14:18.399627822 (12h34m40.143684675s) [upload=12958]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:14:59.902619970 (12h35m21.646676816s) [upload=12977]: Starting upload Aug 7 22:14:59.902685895 (12h35m21.646742756s) [upload=12977]: Done starting upload Aug 7 22:14:59.902751694 (12h35m21.646808545s) [upload=12977]: Uploading segments... Aug 7 22:14:59.902795346 (12h35m21.646852214s) [upload=12977]: Got next segment. Inline: true Aug 7 22:14:59.902801495 (12h35m21.646858346s) [upload=12977]: Waiting for error group managing segments... Aug 7 22:14:59.902858709 (12h35m21.64691556s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:14:59.902863962 (12h35m21.646920811s) [upload=12977]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:14:59.902867458 (12h35m21.646924309s) [upload=12977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:29.636302762 (12h35m51.380359612s) [upload=12977]: Done uploading segments... Aug 7 22:15:29.636325398 (12h35m51.380382249s) [upload=12977]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:45.428850713 (12h36m7.172907563s) [upload=12988]: Starting upload Aug 7 22:15:45.428978829 (12h36m7.173035696s) [upload=12988]: Done starting upload Aug 7 22:15:45.429103446 (12h36m7.173160298s) [upload=12988]: Uploading segments... Aug 7 22:15:45.429150754 (12h36m7.173207623s) [upload=12988]: Got next segment. Inline: true Aug 7 22:15:45.429156339 (12h36m7.173213199s) [upload=12988]: Waiting for error group managing segments... Aug 7 22:15:45.429230361 (12h36m7.173287221s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:45.429247463 (12h36m7.173304325s) [upload=12988]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:15:45.429251133 (12h36m7.173307993s) [upload=12988]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:15.155440875 (12h36m36.899497725s) [upload=12988]: Done uploading segments... Aug 7 22:16:15.155471506 (12h36m36.899528367s) [upload=12988]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:16:15.598565945 (12h36m37.342622791s) [upload=12999]: Starting upload Aug 7 22:16:15.598645050 (12h36m37.342701913s) [upload=12999]: Done starting upload Aug 7 22:16:15.598718650 (12h36m37.342775497s) [upload=12999]: Uploading segments... Aug 7 22:16:15.598774264 (12h36m37.34283113s) [upload=12999]: Got next segment. Inline: true Aug 7 22:16:15.598779124 (12h36m37.342835984s) [upload=12999]: Waiting for error group managing segments... Aug 7 22:16:15.598830461 (12h36m37.342887324s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:15.598854102 (12h36m37.342910963s) [upload=12999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:16:15.598857833 (12h36m37.342914694s) [upload=12999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:16:45.328584439 (12h37m7.072641289s) [upload=12999]: Done uploading segments... Aug 7 22:16:45.328609005 (12h37m7.072665856s) [upload=12999]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:17:27.480756310 (12h37m49.22481316s) [upload=13015]: Starting upload Aug 7 22:17:27.480859326 (12h37m49.22491619s) [upload=13015]: Done starting upload Aug 7 22:17:27.480944450 (12h37m49.225001301s) [upload=13015]: Uploading segments... Aug 7 22:17:27.481000891 (12h37m49.225057757s) [upload=13015]: Got next segment. Inline: true Aug 7 22:17:27.481006468 (12h37m49.225063328s) [upload=13015]: Waiting for error group managing segments... Aug 7 22:17:27.481069727 (12h37m49.225126586s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:27.481076622 (12h37m49.225133484s) [upload=13015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:17:27.481081288 (12h37m49.225138155s) [upload=13015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:17:57.211870572 (12h38m18.955927423s) [upload=13015]: Done uploading segments... Aug 7 22:17:57.211892595 (12h38m18.955949444s) [upload=13015]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:18:14.331617780 (12h38m36.07567463s) [upload=13026]: Starting upload Aug 7 22:18:14.331690520 (12h38m36.07574737s) [upload=13026]: Done starting upload Aug 7 22:18:14.331789874 (12h38m36.075846724s) [upload=13026]: Uploading segments... Aug 7 22:18:14.331829497 (12h38m36.075886363s) [upload=13026]: Got next segment. Inline: true Aug 7 22:18:14.331834588 (12h38m36.075891448s) [upload=13026]: Waiting for error group managing segments... Aug 7 22:18:14.331890028 (12h38m36.075946878s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:14.331895594 (12h38m36.075952444s) [upload=13026]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:18:14.331899378 (12h38m36.075956238s) [upload=13026]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:18:44.050649404 (12h39m5.794706254s) [upload=13026]: Done uploading segments... Aug 7 22:18:44.050671176 (12h39m5.794728026s) [upload=13026]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:19:08.682705115 (12h39m30.42676198s) [upload=13039]: Starting upload Aug 7 22:19:08.682797967 (12h39m30.426854836s) [upload=13039]: Done starting upload Aug 7 22:19:08.682924116 (12h39m30.426980968s) [upload=13039]: Uploading segments... Aug 7 22:19:08.682986486 (12h39m30.427043358s) [upload=13039]: Got next segment. Inline: true Aug 7 22:19:08.682993964 (12h39m30.427050856s) [upload=13039]: Waiting for error group managing segments... Aug 7 22:19:08.683054026 (12h39m30.427110894s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:08.683060373 (12h39m30.427117244s) [upload=13039]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:19:08.683064440 (12h39m30.42712131s) [upload=13039]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:19:38.406368834 (12h40m0.150425697s) [upload=13039]: Done uploading segments... Aug 7 22:19:38.406426692 (12h40m0.150483554s) [upload=13039]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:20:20.517418397 (12h40m42.26147525s) [upload=13053]: Starting upload Aug 7 22:20:20.517575991 (12h40m42.261632856s) [upload=13053]: Done starting upload Aug 7 22:20:20.517715190 (12h40m42.261772059s) [upload=13053]: Uploading segments... Aug 7 22:20:20.517901368 (12h40m42.26195823s) [upload=13053]: Got next segment. Inline: true Aug 7 22:20:20.517963476 (12h40m42.262020457s) [upload=13053]: Waiting for error group managing segments... Aug 7 22:20:20.518079988 (12h40m42.262137053s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:20:20.518123882 (12h40m42.262180743s) [upload=13053]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 22:20:20.518130819 (12h40m42.262187685s) [upload=13053]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:20:50.250392650 (12h41m11.994449511s) [upload=13053]: Done uploading segments... Aug 7 22:20:50.250418123 (12h41m11.994474984s) [upload=13053]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.000855344s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 26 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX......X.X...........................XXXXXXXXX] duration: 1m0.000490554s FAIL (2025-08-07 22:20:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000514127s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [X.X..................................................X......] duration: 288.568693ms remote: "tcp:185.244.226.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 22:20:27 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 288.641989ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [XXXXXXX.X..........................................XXXXXXXXX] duration: 30.00061999s FAIL (2025-08-07 22:20:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00064596s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.....................................XXXXXXXXX] duration: 30.000916729s FAIL (2025-08-07 22:20:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000945776s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [....................XXXX..............................XXXXXX] duration: 1m0.001376224s FAIL (2025-08-07 22:20:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 57.134173791 (12h32m18.878230638s) [noise=true , address=104.36.82.13:4188 , piece_id=C24Q324TD3OIGJSBOKVUN2VH5ORNKINWDHBTA3O56VSRPJN52SGA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.151552906 (12h32m18.895609777s) [noise=true , address=104.36.82.6:4895 , piece_id=HUPRXOSI2CS2UDOF47BME2BYCCLXANUCJAYVZV4JNRMPQQUDZQFA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.151985548 (12h32m18.896042414s) [noise=true , address=104.36.82.60:4343 , piece_id=A5ZQY7FYEN7BVIGGB6T43UTFNOC6NGPBM3XJ23QSLVRFFVSVYJCQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.177078648 (12h32m18.921135515s) [noise=true , address=104.36.82.34:4566 , piece_id=GR2IDGJL2TB5VYWZOIW2C652I5B5XUUXXI4SIELMP3V4GMO2ZH4Q, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.180968885 (12h32m18.925025749s) [noise=true , address=104.36.82.45:4940 , piece_id=E2BSUMWRGNFOCNBBT32GAMW3JN4PFKNKSYXK5AEUGQQKRK4I6FKA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.182573730 (12h32m18.926630601s) [noise=true , address=104.36.82.43:4837 , piece_id=WALP4A6IL6VR6577XHAIATXZGBECNO6BL5Y5Z4I4DMPCNIK7X5QQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.185217873 (12h32m18.929274727s) [noise=true , address=104.36.82.60:4346 , piece_id=OCI6XALWGEOAF64WRNURL5VVPFWYBT24GXK4GNQMUX2MJYZACROQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.191081154 (12h32m18.935138022s) [noise=true , address=104.36.82.23:4448 , piece_id=RD4YTZPX2A4SRE2XWYS45DWZRG6CUS5VLCYBMJPBJ24LGJTGITFQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.205956300 (12h32m18.950013175s) [noise=true , address=104.36.82.36:4645 , piece_id=P63BF2T4FLUK7DMM4GQY277QTDGZXT3CD4Z5GFDMUQTTJN77TZIQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.214668342 (12h32m18.958725212s) [noise=true , address=104.36.82.39:4733 , piece_id=VZPW75CLRYOWCVQGWBWAOGWKFCXYLYOM6OIDMXRBR5IRGZ7DGLLQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.245950582 (12h32m18.990007453s) [noise=true , address=104.36.82.16:4310 , piece_id=UAVZCLFOGCC6T4HX676IX6OWFNRZRTXL3PITG5IZFR2JATIZS2DQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.280359350 (12h32m19.024416213s) [noise=true , address=45.91.116.9:4272 , piece_id=3QGHJZTVECLQTJGC46GZ5276LVTHR36LBTK5Q5FSRGD7QXOUJJ6A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.338710901 (12h32m19.082767752s) [noise=true , address=45.91.116.13:4166 , piece_id=HSFXWLME6GIFAWHD73GW4H6CBPBJZ4MPTB7JD7XY2YBTZESICNRA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.617684582 (12h32m19.361741428s) [noise=true , address=104.36.82.62:4439 , piece_id=2P7NHL5WLDREVBGDS4IMRS6D4DZBQHRYFM7USCDK2KU74SKDLW4A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: <nil> Aug 7 22:11:57.617723267 (12h32m19.361780128s) [seg_pos={0 0}, upload=12925]: Segment reached optimal threshold of 14 pieces. Aug 7 22:11:57.617992734 (12h32m19.36204958s) [noise=true , address=104.36.82.47:4520 , piece_id=DLEDG3JMSGGGFQFGNJWV4XIDPXITG54XCYTRXXJIRR4DOXWIDAVA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eNRsboM5zFiyBVPLuQfgb5QSAc5bZFizK9KJHudNd9nstVGyy): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618089635 (12h32m19.362146495s) [noise=true , address=64.49.13.137:4498 , piece_id=7SLUBM4U2CKK25FCFPHVKBA4D4TKCRZXKASC7LR2ASBM7C7MDQKQ, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nh2t6FxdqbwMky99pfMDNcGXozoMYn4euWvNtThnoTvPMbpS5): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618135706 (12h32m19.362192556s) [noise=true , address=104.36.82.5:4855 , piece_id=OEDGYJGQIIJHLEBR5OPPQCO75KXIGPFZBDCCTBYSUV7XQADJRSAA, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57090->104.36.82.5:4855: use of closed network connection Aug 7 22:11:57.618165938 (12h32m19.362222785s) [noise=true , address=64.49.13.139:4471 , piece_id=QTORROJDLNZQTDC2VFU3Q5DW47TA7VM7FZAVKTACLLCPMHGOC52A, seg_pos={0 0}, upload=12925]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: expected piece hash; context canceled; EOF Aug 7 22:11:57.618181168 (12h32m19.362238028s) [seg_pos={0 0}, upload=12925]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 22:11:57.618262981 (12h32m19.362319833s) [upload=12925]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 22:11:57.618268565 (12h32m19.362325425s) [upload=12925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 22:15:11.462898274 (12h35m33.206955137s) [upload=12925]: Done uploading segments... Aug 7 22:15:11.462927061 (12h35m33.206983911s) [upload=12925]: Upload finished. err: metaclient: context deadline exceeded Aug 7 22:15:11.893865947 (12h35m33.637922798s) [upload=12978]: Starting upload Aug 7 22:15:11.894006161 (12h35m33.638063025s) [upload=12978]: Done starting upload Aug 7 22:15:11.894128456 (12h35m33.63818531s) [upload=12978]: Uploading segments... Aug 7 22:15:11.894439225 (12h35m33.638496094s) [upload=12978]: Got next segment. Inline: false Aug 7 22:15:11.894516777 (12h35m33.638573639s) [upload=12978]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:15:11.894545833 (12h35m33.638602694s) [upload=12978]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:16:11.626077800 (12h36m33.370134666s) [upload=12978]: Next segment err: context deadline exceeded Aug 7 22:16:11.626165441 (12h36m33.370222301s) [upload=12978]: Done uploading segments... Aug 7 22:16:11.626183066 (12h36m33.370239913s) [upload=12978]: Upload finished. err: context deadline exceeded Aug 7 22:16:12.058909015 (12h36m33.802965875s) [upload=12997]: Starting upload Aug 7 22:16:12.058982372 (12h36m33.803039232s) [upload=12997]: Done starting upload Aug 7 22:16:12.059120653 (12h36m33.803177509s) [upload=12997]: Uploading segments... Aug 7 22:16:12.059593126 (12h36m33.803649985s) [upload=12997]: Got next segment. Inline: false Aug 7 22:16:12.059677172 (12h36m33.803734023s) [upload=12997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:16:12.059684424 (12h36m33.803741287s) [upload=12997]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:17:11.787443939 (12h37m33.531500809s) [upload=12997]: Next segment err: context deadline exceeded Aug 7 22:17:11.787498695 (12h37m33.531555556s) [upload=12997]: Done uploading segments... Aug 7 22:17:11.787527052 (12h37m33.531583904s) [upload=12997]: Upload finished. err: context deadline exceeded Aug 7 22:17:12.226578214 (12h37m33.970635065s) [upload=13013]: Starting upload Aug 7 22:17:12.226666960 (12h37m33.970723825s) [upload=13013]: Done starting upload Aug 7 22:17:12.226793229 (12h37m33.970850079s) [upload=13013]: Uploading segments... Aug 7 22:17:12.227044345 (12h37m33.971101196s) [upload=13013]: Got next segment. Inline: false Aug 7 22:17:12.227107713 (12h37m33.971164563s) [upload=13013]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:17:12.227113591 (12h37m33.971170444s) [upload=13013]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:18:11.956251664 (12h38m33.700308534s) [upload=13013]: Next segment err: context deadline exceeded Aug 7 22:18:11.956360027 (12h38m33.700416877s) [upload=13013]: Done uploading segments... Aug 7 22:18:11.956379323 (12h38m33.700436185s) [upload=13013]: Upload finished. err: context deadline exceeded Aug 7 22:18:12.371524537 (12h38m34.115581388s) [upload=13024]: Starting upload Aug 7 22:18:12.371599713 (12h38m34.115656573s) [upload=13024]: Done starting upload Aug 7 22:18:12.371686548 (12h38m34.115743409s) [upload=13024]: Uploading segments... Aug 7 22:18:12.371885224 (12h38m34.115942074s) [upload=13024]: Got next segment. Inline: false Aug 7 22:18:12.371926111 (12h38m34.115982962s) [upload=13024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:18:12.371931665 (12h38m34.115988525s) [upload=13024]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:19:12.105017725 (12h39m33.849074594s) [upload=13024]: Next segment err: context deadline exceeded Aug 7 22:19:12.105111880 (12h39m33.849168731s) [upload=13024]: Done uploading segments... Aug 7 22:19:12.105162034 (12h39m33.849218885s) [upload=13024]: Upload finished. err: context deadline exceeded Aug 7 22:19:14.319119032 (12h39m36.063175896s) [upload=13040]: Starting upload Aug 7 22:19:14.319296351 (12h39m36.063353203s) [upload=13040]: Done starting upload Aug 7 22:19:14.319413921 (12h39m36.063470785s) [upload=13040]: Uploading segments... Aug 7 22:19:14.319749644 (12h39m36.063806505s) [upload=13040]: Got next segment. Inline: false Aug 7 22:19:14.319821004 (12h39m36.063877869s) [upload=13040]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 22:19:14.319827454 (12h39m36.063884319s) [upload=13040]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 22:20:14.045204095 (12h40m35.789261177s) [upload=13040]: Next segment err: context deadline exceeded Aug 7 22:20:14.045278008 (12h40m35.789334861s) [upload=13040]: Done uploading segments... Aug 7 22:20:14.045305281 (12h40m35.789362135s) [upload=13040]: Upload finished. err: context deadline exceeded Duration: 1m0.001415547s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)