Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X.....................X....X...X.........] duration: 2.500409249s FAIL (2025-08-07 19:58:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.500440021s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..................X...........] duration: 968.421523ms FAIL (2025-08-07 19:58:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 968.447842ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X.....................X....X...X........] duration: 2.505727873s FAIL (2025-08-07 19:57:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.505759435s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..................X..........] duration: 1.183879615s FAIL (2025-08-07 19:57:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 1.183905764s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.....................X....X...X.......] duration: 2.597480923s FAIL (2025-08-07 19:57:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.597531561s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X.....................X....X...X......] duration: 2.493341952s FAIL (2025-08-07 19:56:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.493443622s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.....................X....X...X.....] duration: 2.670025271s FAIL (2025-08-07 19:56:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.670061235s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..................X.........] duration: 858.767948ms FAIL (2025-08-07 19:56:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 858.797886ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X.....................X....X...X....] duration: 2.839747019s FAIL (2025-08-07 19:55:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.839778721s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...............................X..................X........] duration: 1.097920009s FAIL (2025-08-07 19:55:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 1.097950567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.....................X....X...X...] duration: 3.120554731s FAIL (2025-08-07 19:54:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 3.120587626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.....................X....X...X..] duration: 3.014009931s FAIL (2025-08-07 19:54:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 3.014042113s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...............................X..................X.......] duration: 941.828279ms FAIL (2025-08-07 19:54:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 941.928376ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.....................X....X...X.] duration: 2.524305882s FAIL (2025-08-07 19:53:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 2.524340076s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...............................X..................X......] duration: 871.971174ms FAIL (2025-08-07 19:53:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 872.004457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X.....................X....X...X] duration: 1.654551674s FAIL (2025-08-07 19:53:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== _ObjectBegin Aug 7 19:53:00.806808399 (10h13m22.550865259s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:01.002519129 (10h13m22.746576028s) [seg_pos={0 0}, upload=10617]: Begin upload segment... Aug 7 19:53:01.002631382 (10h13m22.746688242s) [seg_pos={0 0}, upload=10617]: Done begin upload segment. Aug 7 19:53:01.002677116 (10h13m22.746734023s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.002690232 (10h13m22.746747103s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003208329 (10h13m22.747265177s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003302352 (10h13m22.747359234s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003704915 (10h13m22.747761784s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.003932811 (10h13m22.747989694s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004125350 (10h13m22.748182215s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004349124 (10h13m22.748405995s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004458795 (10h13m22.748515644s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004753041 (10h13m22.748809889s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.004784056 (10h13m22.748840984s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005256843 (10h13m22.749313719s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.005741176 (10h13m22.749798048s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006259603 (10h13m22.75031649s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006759243 (10h13m22.750816113s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.006960539 (10h13m22.751017409s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007287268 (10h13m22.751344119s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.007684069 (10h13m22.75174092s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Uploading piece... Aug 7 19:53:01.572469694 (10h13m23.316526566s) [upload=10617]: Next returned nil segment Aug 7 19:53:01.572493371 (10h13m23.316550251s) [upload=10617]: Waiting for error group managing segments... Aug 7 19:53:01.732898588 (10h13m23.476955455s) [noise=true , address=104.36.82.12:4181 , piece_id=RAJB7OY3RIV473SVKV2LLWJQVORMEMHCU5IUTGLMNWLOH4X3KRBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.740063910 (10h13m23.484120773s) [noise=true , address=45.91.116.14:4195 , piece_id=WC5D3F5K5DDQB5RNRKY7BW7QNINXDKMJ7HKNNZBJHNXRMIBWXSRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.748521371 (10h13m23.492578234s) [noise=true , address=104.36.82.62:4415 , piece_id=M7RWJKHLDXHSUNLR7LPZX2ATCVDHR4VXIYXCTLJLFTZ3YO4ENYRQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.752894924 (10h13m23.496951801s) [noise=true , address=104.36.82.9:4038 , piece_id=HBW2WH6MHTRQLWZCWKQTLZ3BL5Q7ZXCN6XCGGF7YMTDCU3LAFA6A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.756504621 (10h13m23.500561467s) [noise=true , address=104.36.82.59:4312 , piece_id=DPEBAYP2RVIJS4JGSSIYS5UTPCMJXBNSXTTUJIVLFTHQ2ULDC5HA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.759719933 (10h13m23.503776803s) [noise=true , address=104.36.82.60:4353 , piece_id=76T67FNBQNU2GWPDCH7CA4GOGFNRRUAH43R6QQZRGFWOB7RJ6TCA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.760667917 (10h13m23.50472478s) [noise=true , address=104.36.82.37:4655 , piece_id=7D5VCLNFBWICMJRJCG3JFZCBAD7N7OIXY3L7OGGSO6GBDK6TJT2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.763810855 (10h13m23.507867711s) [noise=true , address=104.36.82.46:4516 , piece_id=Y3Q4KVKNTVHIM7KZBNFLPVB5AUYYX24SKKUOSYCILPVRUEQ7KGOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.770262920 (10h13m23.514319786s) [noise=true , address=104.36.82.39:4755 , piece_id=UDIPMBB3KFB3EYSPNFQLO6UH42RRVFOTFWAPHUQGUV6VIQ7VBCHQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.776729794 (10h13m23.520786666s) [noise=true , address=104.36.82.61:4386 , piece_id=ZGQ57MSFZD3MDPR462W2GGWVX7ZBXHHQSETKPSF73YXQUJICL4FQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.781550207 (10h13m23.525607124s) [noise=true , address=104.36.82.23:4445 , piece_id=UREPEZL6DDXTRPEA66TTZIT5ZJQ2EXTBSSR6BFKW7V7NJI7EQY2A, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.784086163 (10h13m23.528143039s) [noise=true , address=104.36.82.8:4995 , piece_id=VHSEAQY7BOSSMV6WJCEBA3AEM3LNVFMNCLUIT7KJPMBFVBHYP3IQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.794091691 (10h13m23.538148549s) [noise=true , address=104.36.82.47:4546 , piece_id=A3R7VDHDXOQKDWWE2XC4RN36SMMZDQPH6PNCZQCHVGMOMPDLDXHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836399459 (10h13m23.580456387s) [noise=true , address=104.36.82.45:4924 , piece_id=QXRNYNJCLMTFJRE55JZ3ZIZGGEFXZAZCQJTVGAWEVK74NWS2TEHA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: <nil> Aug 7 19:53:01.836452508 (10h13m23.580509374s) [seg_pos={0 0}, upload=10617]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:01.836878951 (10h13m23.580935809s) [noise=true , address=104.36.82.20:4472 , piece_id=2PXDGKZJCAPUYYGYQDDDSEBCOIG2TUMOXT5RBETQDNJKO66NJXOA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GACnovbrme3fQknSDpZWVLq838VKop9mPjxnVXGdJ8KaqyaTi): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837141672 (10h13m23.581198536s) [noise=true , address=79.127.201.215:4348 , piece_id=SZXCUAS7DN532CO25PSV47NSPBZONMSOLSWKD3CIVPG2SDZGTIXQ, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:01.837833642 (10h13m23.581890505s) [noise=true , address=64.49.13.26:4948 , piece_id=HQ6ADAHGSETEQ7LOVFNKNNY5TFD72GE6HI5DNDXY72Z5BYJ6JCMA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39754->64.49.13.26:4948: use of closed network connection Aug 7 19:53:01.837861618 (10h13m23.581918476s) [noise=true , address=64.49.13.169:4706 , piece_id=ANCSGROTKIV47AOHE3TAC5WYTLIU26NVT2AU5HMU4OCAXWRXHVBA, seg_pos={0 0}, upload=10617]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35698->64.49.13.169:4706: use of closed network connection Aug 7 19:53:01.837897216 (10h13m23.581954093s) [seg_pos={0 0}, upload=10617]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:01.838079381 (10h13m23.582136262s) [upload=10617]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:01.838087494 (10h13m23.582144387s) [upload=10617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:01.990552963 (10h13m23.734609836s) [upload=10617]: Done uploading segments... Aug 7 19:53:01.990579447 (10h13m23.734636321s) [upload=10617]: Upload finished. err: <nil> Duration:* 1.654607884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.....................X....X...] duration: 2.692615614s FAIL (2025-08-07 19:51:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 96865ccacc5e4895cddc902b611fdcb7ae32b1a1180877916d2d285dba847757 != before fa4375a22c0c035504c31888cf415e1f95b81227ab504fb8383e61a44aa44bbf ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:49:34.748891372 (10h9m56.492948232s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:49:34.960520705 (10h9m56.704577554s) [seg_pos={0 0}, upload=10563]: Begin upload segment... Aug 7 19:49:34.960589770 (10h9m56.704646622s) [seg_pos={0 0}, upload=10563]: Done begin upload segment. Aug 7 19:49:34.960637452 (10h9m56.704694323s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.960680432 (10h9m56.704737301s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961189147 (10h9m56.705246013s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961293750 (10h9m56.705350616s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961523706 (10h9m56.705580566s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961729294 (10h9m56.705786162s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961827204 (10h9m56.705884064s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962148276 (10h9m56.70620514s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962192662 (10h9m56.706249523s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962531670 (10h9m56.70658853s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962549983 (10h9m56.706606853s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962919498 (10h9m56.706976363s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963423575 (10h9m56.707480441s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963726664 (10h9m56.707783525s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.964011188 (10h9m56.708068048s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.967519044 (10h9m56.711575914s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968077302 (10h9m56.712134165s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968098484 (10h9m56.71215533s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:35.517736851 (10h9m57.261793711s) [upload=10563]: Next returned nil segment Aug 7 19:49:35.517757945 (10h9m57.261814795s) [upload=10563]: Waiting for error group managing segments... Aug 7 19:49:35.676650432 (10h9m57.420707279s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.690848971 (10h9m57.434905823s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.694516002 (10h9m57.438572848s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.709018507 (10h9m57.453075356s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.712825081 (10h9m57.456881928s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.719917269 (10h9m57.463974123s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.734208920 (10h9m57.478265768s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.737040688 (10h9m57.481097542s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.738873596 (10h9m57.482930447s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.747003918 (10h9m57.491060763s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.749751045 (10h9m57.493807891s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.750597917 (10h9m57.494654772s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.753035033 (10h9m57.49709188s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768108373 (10h9m57.512165225s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768130350 (10h9m57.512187205s) [seg_pos={0 0}, upload=10563]: Segment reached optimal threshold of 14 pieces. Aug 7 19:49:35.768530525 (10h9m57.512587376s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768641368 (10h9m57.512698218s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection Aug 7 19:49:35.768907175 (10h9m57.512964026s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768990061 (10h9m57.513046912s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection Aug 7 19:49:35.769010586 (10h9m57.513067438s) [seg_pos={0 0}, upload=10563]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:49:35.769088096 (10h9m57.513144946s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:49:35.769092681 (10h9m57.513149532s) [upload=10563]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:49:35.917878641 (10h9m57.661935493s) [upload=10563]: Done uploading segments... Aug 7 19:49:35.917898468 (10h9m57.661955318s) [upload=10563]: Upload finished. err: <nil> Duration: 2.692647699s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...............................X..................X.....] duration: 996.485113ms FAIL (2025-08-07 19:51:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 996.529133ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...............................X..................X....] duration: 845.912905ms FAIL (2025-08-07 19:51:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 845.945256ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.....................X....X..] duration: 2.463488188s FAIL (2025-08-07 19:50:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 96865ccacc5e4895cddc902b611fdcb7ae32b1a1180877916d2d285dba847757 != before fa4375a22c0c035504c31888cf415e1f95b81227ab504fb8383e61a44aa44bbf ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:49:34.748891372 (10h9m56.492948232s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:49:34.960520705 (10h9m56.704577554s) [seg_pos={0 0}, upload=10563]: Begin upload segment... Aug 7 19:49:34.960589770 (10h9m56.704646622s) [seg_pos={0 0}, upload=10563]: Done begin upload segment. Aug 7 19:49:34.960637452 (10h9m56.704694323s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.960680432 (10h9m56.704737301s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961189147 (10h9m56.705246013s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961293750 (10h9m56.705350616s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961523706 (10h9m56.705580566s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961729294 (10h9m56.705786162s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961827204 (10h9m56.705884064s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962148276 (10h9m56.70620514s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962192662 (10h9m56.706249523s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962531670 (10h9m56.70658853s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962549983 (10h9m56.706606853s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962919498 (10h9m56.706976363s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963423575 (10h9m56.707480441s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963726664 (10h9m56.707783525s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.964011188 (10h9m56.708068048s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.967519044 (10h9m56.711575914s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968077302 (10h9m56.712134165s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968098484 (10h9m56.71215533s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:35.517736851 (10h9m57.261793711s) [upload=10563]: Next returned nil segment Aug 7 19:49:35.517757945 (10h9m57.261814795s) [upload=10563]: Waiting for error group managing segments... Aug 7 19:49:35.676650432 (10h9m57.420707279s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.690848971 (10h9m57.434905823s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.694516002 (10h9m57.438572848s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.709018507 (10h9m57.453075356s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.712825081 (10h9m57.456881928s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.719917269 (10h9m57.463974123s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.734208920 (10h9m57.478265768s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.737040688 (10h9m57.481097542s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.738873596 (10h9m57.482930447s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.747003918 (10h9m57.491060763s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.749751045 (10h9m57.493807891s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.750597917 (10h9m57.494654772s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.753035033 (10h9m57.49709188s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768108373 (10h9m57.512165225s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768130350 (10h9m57.512187205s) [seg_pos={0 0}, upload=10563]: Segment reached optimal threshold of 14 pieces. Aug 7 19:49:35.768530525 (10h9m57.512587376s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768641368 (10h9m57.512698218s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection Aug 7 19:49:35.768907175 (10h9m57.512964026s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768990061 (10h9m57.513046912s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection Aug 7 19:49:35.769010586 (10h9m57.513067438s) [seg_pos={0 0}, upload=10563]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:49:35.769088096 (10h9m57.513144946s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:49:35.769092681 (10h9m57.513149532s) [upload=10563]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:49:35.917878641 (10h9m57.661935493s) [upload=10563]: Done uploading segments... Aug 7 19:49:35.917898468 (10h9m57.661955318s) [upload=10563]: Upload finished. err: <nil> Duration: 2.46352308s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............................X..................X...] duration: 1.039383718s FAIL (2025-08-07 19:50:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 1.03941655s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.....................X....X.] duration: 2.699619217s FAIL (2025-08-07 19:50:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 96865ccacc5e4895cddc902b611fdcb7ae32b1a1180877916d2d285dba847757 != before fa4375a22c0c035504c31888cf415e1f95b81227ab504fb8383e61a44aa44bbf ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:49:34.748891372 (10h9m56.492948232s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:49:34.960520705 (10h9m56.704577554s) [seg_pos={0 0}, upload=10563]: Begin upload segment... Aug 7 19:49:34.960589770 (10h9m56.704646622s) [seg_pos={0 0}, upload=10563]: Done begin upload segment. Aug 7 19:49:34.960637452 (10h9m56.704694323s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.960680432 (10h9m56.704737301s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961189147 (10h9m56.705246013s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961293750 (10h9m56.705350616s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961523706 (10h9m56.705580566s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961729294 (10h9m56.705786162s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961827204 (10h9m56.705884064s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962148276 (10h9m56.70620514s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962192662 (10h9m56.706249523s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962531670 (10h9m56.70658853s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962549983 (10h9m56.706606853s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962919498 (10h9m56.706976363s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963423575 (10h9m56.707480441s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963726664 (10h9m56.707783525s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.964011188 (10h9m56.708068048s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.967519044 (10h9m56.711575914s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968077302 (10h9m56.712134165s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968098484 (10h9m56.71215533s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:35.517736851 (10h9m57.261793711s) [upload=10563]: Next returned nil segment Aug 7 19:49:35.517757945 (10h9m57.261814795s) [upload=10563]: Waiting for error group managing segments... Aug 7 19:49:35.676650432 (10h9m57.420707279s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.690848971 (10h9m57.434905823s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.694516002 (10h9m57.438572848s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.709018507 (10h9m57.453075356s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.712825081 (10h9m57.456881928s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.719917269 (10h9m57.463974123s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.734208920 (10h9m57.478265768s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.737040688 (10h9m57.481097542s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.738873596 (10h9m57.482930447s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.747003918 (10h9m57.491060763s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.749751045 (10h9m57.493807891s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.750597917 (10h9m57.494654772s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.753035033 (10h9m57.49709188s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768108373 (10h9m57.512165225s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768130350 (10h9m57.512187205s) [seg_pos={0 0}, upload=10563]: Segment reached optimal threshold of 14 pieces. Aug 7 19:49:35.768530525 (10h9m57.512587376s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768641368 (10h9m57.512698218s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection Aug 7 19:49:35.768907175 (10h9m57.512964026s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768990061 (10h9m57.513046912s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection Aug 7 19:49:35.769010586 (10h9m57.513067438s) [seg_pos={0 0}, upload=10563]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:49:35.769088096 (10h9m57.513144946s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:49:35.769092681 (10h9m57.513149532s) [upload=10563]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:49:35.917878641 (10h9m57.661935493s) [upload=10563]: Done uploading segments... Aug 7 19:49:35.917898468 (10h9m57.661955318s) [upload=10563]: Upload finished. err: <nil> Duration: 2.699667072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X...............................X..................X..] duration: 839.539535ms FAIL (2025-08-07 19:49:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 839.566458ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.....................X....X] duration: 2.404677054s FAIL (2025-08-07 19:49:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 96865ccacc5e4895cddc902b611fdcb7ae32b1a1180877916d2d285dba847757 != before fa4375a22c0c035504c31888cf415e1f95b81227ab504fb8383e61a44aa44bbf ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:49:34.748891372 (10h9m56.492948232s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:49:34.960520705 (10h9m56.704577554s) [seg_pos={0 0}, upload=10563]: Begin upload segment... Aug 7 19:49:34.960589770 (10h9m56.704646622s) [seg_pos={0 0}, upload=10563]: Done begin upload segment. Aug 7 19:49:34.960637452 (10h9m56.704694323s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.960680432 (10h9m56.704737301s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961189147 (10h9m56.705246013s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961293750 (10h9m56.705350616s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961523706 (10h9m56.705580566s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961729294 (10h9m56.705786162s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.961827204 (10h9m56.705884064s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962148276 (10h9m56.70620514s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962192662 (10h9m56.706249523s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962531670 (10h9m56.70658853s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962549983 (10h9m56.706606853s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.962919498 (10h9m56.706976363s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963423575 (10h9m56.707480441s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.963726664 (10h9m56.707783525s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.964011188 (10h9m56.708068048s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.967519044 (10h9m56.711575914s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968077302 (10h9m56.712134165s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:34.968098484 (10h9m56.71215533s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Uploading piece... Aug 7 19:49:35.517736851 (10h9m57.261793711s) [upload=10563]: Next returned nil segment Aug 7 19:49:35.517757945 (10h9m57.261814795s) [upload=10563]: Waiting for error group managing segments... Aug 7 19:49:35.676650432 (10h9m57.420707279s) [noise=true , address=77.90.31.14:4667 , piece_id=QIRAOMMMWM7NBGF6HDE5CTOPJZLIZQTBKURTEV64X4NLOGFIDEDQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.690848971 (10h9m57.434905823s) [noise=true , address=45.91.116.6:4988 , piece_id=GRDE2FF7F3VWUJLJIQD55TSRY2MD5A4YCIZE44XGYMZUENZOY4XQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.694516002 (10h9m57.438572848s) [noise=true , address=77.90.31.11:4568 , piece_id=D2HJMJKLAGRHN74VCYNHQ75CZ532FAIWHXITMTC6PU22ET6UE4FA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.709018507 (10h9m57.453075356s) [noise=true , address=104.36.82.62:4441 , piece_id=6XNFTBVH764ZZO6PFEXDS7C74WPWEPL6IPISUZIZXSZDXPXFMUVA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.712825081 (10h9m57.456881928s) [noise=true , address=104.36.82.37:4670 , piece_id=5LBWWDRUNPQSVCHQO5BIHTKGL7L6LJMXULHD637KDIVB2M6CHECA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.719917269 (10h9m57.463974123s) [noise=true , address=104.36.82.16:4319 , piece_id=4ATPRLTJDQQ3BLTGD3KTN7ARN6ZBEIWZX422AMCAMGUCLEXQZT2A, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.734208920 (10h9m57.478265768s) [noise=true , address=104.36.82.44:4877 , piece_id=AKARTGTWYM5Z2ANUXQ3X2BSZUDHWBEDAQLJXSPKBJYDDTQ7TWTOA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.737040688 (10h9m57.481097542s) [noise=true , address=104.36.82.47:4518 , piece_id=XII7A3JQZ7L37VWCOG7JYJKKXBKJNK4GWPXEH2QSGGG7JOSAZ6IA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.738873596 (10h9m57.482930447s) [noise=true , address=104.36.82.10:4091 , piece_id=FNOTNJNH7JZWRAAWN6HF52B2GV236AFDAN3BCBCWYQDSLSBD7BSQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.747003918 (10h9m57.491060763s) [noise=true , address=45.91.116.10:4087 , piece_id=HQ6NNAKJLTPA5QDZSSKXR4YUITB2YI5M6XD3MG623XPQE2LIGHHQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.749751045 (10h9m57.493807891s) [noise=true , address=104.36.82.58:4299 , piece_id=LGF4CQCMQYGA3K4G5FDEYZHECKP3MGP2IKROVVLDVSFHUCMHRGGA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.750597917 (10h9m57.494654772s) [noise=true , address=104.36.82.43:4856 , piece_id=QBO54DGYHQTEH6I4QYPHDGB3HATA26RCZ5IQZ4CAUV4S5HTFJPPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.753035033 (10h9m57.49709188s) [noise=true , address=104.36.82.9:4023 , piece_id=BJRVU3G4DLN35OZJK6L2I4HOAOGHFZ4DBEDKEHYL2JTNKXHPC5BA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768108373 (10h9m57.512165225s) [noise=true , address=104.36.82.54:4188 , piece_id=MD2ZMHDGCIHTXZEVA22XITNFKBLMU2LNPVSEGKRLVIAHZEHN6YZA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: <nil> Aug 7 19:49:35.768130350 (10h9m57.512187205s) [seg_pos={0 0}, upload=10563]: Segment reached optimal threshold of 14 pieces. Aug 7 19:49:35.768530525 (10h9m57.512587376s) [noise=true , address=79.127.201.215:4351 , piece_id=T33QMEDVHA5HMNLTTJLMNLT2WTN3TDL33742BBRT3JUM5EPT6VPQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768641368 (10h9m57.512698218s) [noise=true , address=64.49.13.140:4516 , piece_id=QZ4J4QCNCDPN3SWXQHZ7TDTX4EHZXCDPYNRQM32TGN4JFVF7WOEA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59734->64.49.13.140:4516: use of closed network connection Aug 7 19:49:35.768907175 (10h9m57.512964026s) [noise=true , address=104.36.82.55:4210 , piece_id=MXNZH4NVRTJXP6DPWSOUIDBVU6KXOXY3XN4VXHQW3ABHR6HMWNFA, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoSWvJCc3mfowPPSJkdCDewkrHZnG6gz1fWcmJRGR5wvHzLL): protocol: expected piece hash; context canceled; EOF Aug 7 19:49:35.768990061 (10h9m57.513046912s) [noise=true , address=79.127.205.233:4643 , piece_id=TOWWZQGCGKGT76VIAXMWW3RM3AIUJEDLIAVKFYI2CYMD4XOZBMUQ, seg_pos={0 0}, upload=10563]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40226->79.127.205.233:4643: use of closed network connection Aug 7 19:49:35.769010586 (10h9m57.513067438s) [seg_pos={0 0}, upload=10563]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:49:35.769088096 (10h9m57.513144946s) [upload=10563]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:49:35.769092681 (10h9m57.513149532s) [upload=10563]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:49:35.917878641 (10h9m57.661935493s) [upload=10563]: Done uploading segments... Aug 7 19:49:35.917898468 (10h9m57.661955318s) [upload=10563]: Upload finished. err: <nil> Duration: 2.404706675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X...............................X..................X.] duration: 875.18878ms FAIL (2025-08-07 19:49:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 875.21341ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.....................X....] duration: 2.936862389s FAIL (2025-08-07 19:48:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== oad Aug 7 19:47:01.415199606 (10h7m23.159256469s) [upload=10523]: Uploading segments... Aug 7 19:47:01.415695790 (10h7m23.159752663s) [upload=10523]: Got next segment. Inline: false Aug 7 19:47:01.415853941 (10h7m23.159910814s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:01.415861658 (10h7m23.159918531s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:47:01.613613523 (10h7m23.357670393s) [seg_pos={0 0}, upload=10523]: Begin upload segment... Aug 7 19:47:01.613725253 (10h7m23.357782115s) [seg_pos={0 0}, upload=10523]: Done begin upload segment. Aug 7 19:47:01.613772896 (10h7m23.357829769s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.613789652 (10h7m23.357846519s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614408541 (10h7m23.358465416s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614580084 (10h7m23.358636957s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614955042 (10h7m23.359011913s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.615627191 (10h7m23.359684065s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616190198 (10h7m23.360247086s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616308606 (10h7m23.360365481s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616817087 (10h7m23.360873952s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616955702 (10h7m23.361012574s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.617641308 (10h7m23.361698186s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618552324 (10h7m23.362609201s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618638876 (10h7m23.36269575s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.619656401 (10h7m23.363713274s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.620376540 (10h7m23.364433412s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.621021271 (10h7m23.365078145s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.622173439 (10h7m23.366230312s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.623587274 (10h7m23.367644148s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:02.242265094 (10h7m23.986321948s) [upload=10523]: Next returned nil segment Aug 7 19:47:02.242286312 (10h7m23.986343178s) [upload=10523]: Waiting for error group managing segments... Aug 7 19:47:02.408548355 (10h7m24.152605206s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.432982525 (10h7m24.177039373s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.435399268 (10h7m24.17945613s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.447991738 (10h7m24.192048615s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.451951874 (10h7m24.196008728s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.458919218 (10h7m24.202976065s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.466189567 (10h7m24.210246443s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.467929013 (10h7m24.211985879s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.468659781 (10h7m24.212716634s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469273072 (10h7m24.213329936s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469966415 (10h7m24.21402327s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.494165936 (10h7m24.238222792s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.505712650 (10h7m24.249769516s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522769006 (10h7m24.266825876s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522826675 (10h7m24.266883544s) [seg_pos={0 0}, upload=10523]: Segment reached optimal threshold of 14 pieces. Aug 7 19:47:02.523183672 (10h7m24.267240551s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523298505 (10h7m24.267355356s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523509458 (10h7m24.267566331s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523763241 (10h7m24.267820119s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection Aug 7 19:47:02.523891464 (10h7m24.267948316s) [seg_pos={0 0}, upload=10523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:47:02.524080825 (10h7m24.268137697s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:47:02.524088263 (10h7m24.268145137s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:03.465799756 (10h7m25.209856627s) [upload=10523]: Done uploading segments... Aug 7 19:47:03.465870105 (10h7m25.209926954s) [upload=10523]: Upload finished. err: <nil> Duration: 2.936890092s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.....................X...] duration: 2.47393972s FAIL (2025-08-07 19:48:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== oad Aug 7 19:47:01.415199606 (10h7m23.159256469s) [upload=10523]: Uploading segments... Aug 7 19:47:01.415695790 (10h7m23.159752663s) [upload=10523]: Got next segment. Inline: false Aug 7 19:47:01.415853941 (10h7m23.159910814s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:01.415861658 (10h7m23.159918531s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:47:01.613613523 (10h7m23.357670393s) [seg_pos={0 0}, upload=10523]: Begin upload segment... Aug 7 19:47:01.613725253 (10h7m23.357782115s) [seg_pos={0 0}, upload=10523]: Done begin upload segment. Aug 7 19:47:01.613772896 (10h7m23.357829769s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.613789652 (10h7m23.357846519s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614408541 (10h7m23.358465416s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614580084 (10h7m23.358636957s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614955042 (10h7m23.359011913s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.615627191 (10h7m23.359684065s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616190198 (10h7m23.360247086s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616308606 (10h7m23.360365481s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616817087 (10h7m23.360873952s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616955702 (10h7m23.361012574s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.617641308 (10h7m23.361698186s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618552324 (10h7m23.362609201s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618638876 (10h7m23.36269575s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.619656401 (10h7m23.363713274s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.620376540 (10h7m23.364433412s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.621021271 (10h7m23.365078145s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.622173439 (10h7m23.366230312s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.623587274 (10h7m23.367644148s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:02.242265094 (10h7m23.986321948s) [upload=10523]: Next returned nil segment Aug 7 19:47:02.242286312 (10h7m23.986343178s) [upload=10523]: Waiting for error group managing segments... Aug 7 19:47:02.408548355 (10h7m24.152605206s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.432982525 (10h7m24.177039373s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.435399268 (10h7m24.17945613s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.447991738 (10h7m24.192048615s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.451951874 (10h7m24.196008728s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.458919218 (10h7m24.202976065s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.466189567 (10h7m24.210246443s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.467929013 (10h7m24.211985879s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.468659781 (10h7m24.212716634s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469273072 (10h7m24.213329936s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469966415 (10h7m24.21402327s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.494165936 (10h7m24.238222792s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.505712650 (10h7m24.249769516s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522769006 (10h7m24.266825876s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522826675 (10h7m24.266883544s) [seg_pos={0 0}, upload=10523]: Segment reached optimal threshold of 14 pieces. Aug 7 19:47:02.523183672 (10h7m24.267240551s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523298505 (10h7m24.267355356s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523509458 (10h7m24.267566331s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523763241 (10h7m24.267820119s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection Aug 7 19:47:02.523891464 (10h7m24.267948316s) [seg_pos={0 0}, upload=10523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:47:02.524080825 (10h7m24.268137697s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:47:02.524088263 (10h7m24.268145137s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:03.465799756 (10h7m25.209856627s) [upload=10523]: Done uploading segments... Aug 7 19:47:03.465870105 (10h7m25.209926954s) [upload=10523]: Upload finished. err: <nil> Duration: 2.473966096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X...............................X..................X] duration: 763.24611ms FAIL (2025-08-07 19:48:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== b.BatchRequestItem_ObjectCommit Aug 7 19:41:04.953338678 (10h1m26.697395549s) [upload=10422]: Done uploading segments... Aug 7 19:41:04.953362122 (10h1m26.697418968s) [upload=10422]: Upload finished. err: <nil> Aug 7 19:42:08.582939681 (10h2m30.326996555s) [upload=10439]: Starting upload Aug 7 19:42:08.583027365 (10h2m30.327084235s) [upload=10439]: Done starting upload Aug 7 19:42:08.583105032 (10h2m30.327161881s) [upload=10439]: Uploading segments... Aug 7 19:42:08.583213023 (10h2m30.327269894s) [upload=10439]: Got next segment. Inline: true Aug 7 19:42:08.583219417 (10h2m30.327276288s) [upload=10439]: Waiting for error group managing segments... Aug 7 19:42:08.583286832 (10h2m30.327343699s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:08.583296191 (10h2m30.327353061s) [upload=10439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:08.583300207 (10h2m30.327357075s) [upload=10439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:08.737221317 (10h2m30.481278167s) [upload=10439]: Done uploading segments... Aug 7 19:42:08.737239444 (10h2m30.481296294s) [upload=10439]: Upload finished. err: <nil> Aug 7 19:42:35.754502400 (10h2m57.498559269s) [upload=10447]: Starting upload Aug 7 19:42:35.754580432 (10h2m57.498637292s) [upload=10447]: Done starting upload Aug 7 19:42:35.754662038 (10h2m57.498718888s) [upload=10447]: Uploading segments... Aug 7 19:42:35.754717501 (10h2m57.498774363s) [upload=10447]: Got next segment. Inline: true Aug 7 19:42:35.754723550 (10h2m57.498780411s) [upload=10447]: Waiting for error group managing segments... Aug 7 19:42:35.754769812 (10h2m57.498826664s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:42:35.754775480 (10h2m57.498832331s) [upload=10447]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:42:35.754791044 (10h2m57.498847904s) [upload=10447]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:42:35.960673198 (10h2m57.70473007s) [upload=10447]: Done uploading segments... Aug 7 19:42:35.960712853 (10h2m57.704769723s) [upload=10447]: Upload finished. err: <nil> Aug 7 19:43:15.692841644 (10h3m37.436898504s) [upload=10459]: Starting upload Aug 7 19:43:15.692895340 (10h3m37.4369522s) [upload=10459]: Done starting upload Aug 7 19:43:15.693025447 (10h3m37.437082294s) [upload=10459]: Uploading segments... Aug 7 19:43:15.693096915 (10h3m37.437153784s) [upload=10459]: Got next segment. Inline: true Aug 7 19:43:15.693102219 (10h3m37.437159079s) [upload=10459]: Waiting for error group managing segments... Aug 7 19:43:15.693156439 (10h3m37.437213286s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:43:15.693160962 (10h3m37.437217809s) [upload=10459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:43:15.693163639 (10h3m37.437220498s) [upload=10459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:43:15.842964617 (10h3m37.587021467s) [upload=10459]: Done uploading segments... Aug 7 19:43:15.842984600 (10h3m37.58704145s) [upload=10459]: Upload finished. err: <nil> Aug 7 19:44:27.624172741 (10h4m49.368229614s) [upload=10478]: Starting upload Aug 7 19:44:27.624259960 (10h4m49.368316829s) [upload=10478]: Done starting upload Aug 7 19:44:27.624391347 (10h4m49.368448199s) [upload=10478]: Uploading segments... Aug 7 19:44:27.624465387 (10h4m49.368522255s) [upload=10478]: Got next segment. Inline: true Aug 7 19:44:27.624472592 (10h4m49.368529463s) [upload=10478]: Waiting for error group managing segments... Aug 7 19:44:27.624538644 (10h4m49.368595517s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:44:27.624544526 (10h4m49.368601393s) [upload=10478]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:44:27.624548493 (10h4m49.368605357s) [upload=10478]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:44:27.775061965 (10h4m49.519118825s) [upload=10478]: Done uploading segments... Aug 7 19:44:27.775083237 (10h4m49.519140086s) [upload=10478]: Upload finished. err: <nil> Aug 7 19:45:11.245218927 (10h5m32.989275814s) [upload=10494]: Starting upload Aug 7 19:45:11.245274924 (10h5m32.989331795s) [upload=10494]: Done starting upload Aug 7 19:45:11.245352915 (10h5m32.989409762s) [upload=10494]: Uploading segments... Aug 7 19:45:11.245407480 (10h5m32.989464353s) [upload=10494]: Got next segment. Inline: true Aug 7 19:45:11.245413968 (10h5m32.989470841s) [upload=10494]: Waiting for error group managing segments... Aug 7 19:45:11.245512290 (10h5m32.989569145s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:45:11.245521173 (10h5m32.989578047s) [upload=10494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:45:11.245524664 (10h5m32.989581533s) [upload=10494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:45:11.415999423 (10h5m33.160056295s) [upload=10494]: Done uploading segments... Aug 7 19:45:11.416019246 (10h5m33.160076108s) [upload=10494]: Upload finished. err: <nil> Aug 7 19:46:11.323139233 (10h6m33.067196093s) [upload=10508]: Starting upload Aug 7 19:46:11.323244980 (10h6m33.067301841s) [upload=10508]: Done starting upload Aug 7 19:46:11.323442361 (10h6m33.067499208s) [upload=10508]: Uploading segments... Aug 7 19:46:11.323513291 (10h6m33.067570154s) [upload=10508]: Got next segment. Inline: true Aug 7 19:46:11.323521073 (10h6m33.067577935s) [upload=10508]: Waiting for error group managing segments... Aug 7 19:46:11.323567530 (10h6m33.067624392s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:11.323587019 (10h6m33.067643887s) [upload=10508]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:11.323592237 (10h6m33.067649098s) [upload=10508]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:11.481168025 (10h6m33.225224896s) [upload=10508]: Done uploading segments... Aug 7 19:46:11.481190715 (10h6m33.225247577s) [upload=10508]: Upload finished. err: <nil> Aug 7 19:46:32.656097085 (10h6m54.400153936s) [upload=10514]: Starting upload Aug 7 19:46:32.656201123 (10h6m54.40025799s) [upload=10514]: Done starting upload Aug 7 19:46:32.656343492 (10h6m54.400400354s) [upload=10514]: Uploading segments... Aug 7 19:46:32.656411886 (10h6m54.400468758s) [upload=10514]: Got next segment. Inline: true Aug 7 19:46:32.656418700 (10h6m54.400475564s) [upload=10514]: Waiting for error group managing segments... Aug 7 19:46:32.656486916 (10h6m54.400543776s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:32.656493157 (10h6m54.400550017s) [upload=10514]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:32.656496986 (10h6m54.400553845s) [upload=10514]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:32.813859524 (10h6m54.557916385s) [upload=10514]: Done uploading segments... Aug 7 19:46:32.813895891 (10h6m54.557952741s) [upload=10514]: Upload finished. err: <nil> Aug 7 19:46:49.279963657 (10h7m11.024020525s) [upload=10520]: Starting upload Aug 7 19:46:49.280039660 (10h7m11.02409652s) [upload=10520]: Done starting upload Aug 7 19:46:49.280132774 (10h7m11.024189636s) [upload=10520]: Uploading segments... Aug 7 19:46:49.280216817 (10h7m11.024273685s) [upload=10520]: Got next segment. Inline: true Aug 7 19:46:49.280224247 (10h7m11.024281107s) [upload=10520]: Waiting for error group managing segments... Aug 7 19:46:49.280274211 (10h7m11.024331072s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:46:49.280280387 (10h7m11.02433725s) [upload=10520]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:46:49.280283761 (10h7m11.024340621s) [upload=10520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:46:49.674162684 (10h7m11.418219535s) [upload=10520]: Done uploading segments... Aug 7 19:46:49.674193610 (10h7m11.41825046s) [upload=10520]: Upload finished. err: <nil> Aug 7 19:47:06.644094340 (10h7m28.388151211s) [upload=10526]: Starting upload Aug 7 19:47:06.644186607 (10h7m28.388243475s) [upload=10526]: Done starting upload Aug 7 19:47:06.644293785 (10h7m28.38835064s) [upload=10526]: Uploading segments... Aug 7 19:47:06.644359894 (10h7m28.388416763s) [upload=10526]: Got next segment. Inline: true Aug 7 19:47:06.644365436 (10h7m28.388422297s) [upload=10526]: Waiting for error group managing segments... Aug 7 19:47:06.644415216 (10h7m28.38847208s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:06.644422288 (10h7m28.388479149s) [upload=10526]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:47:06.644425759 (10h7m28.388482621s) [upload=10526]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:06.808985866 (10h7m28.553042835s) [upload=10526]: Done uploading segments... Aug 7 19:47:06.809010814 (10h7m28.553067669s) [upload=10526]: Upload finished. err: <nil> Aug 7 19:48:16.505183312 (10h8m38.249240159s) [upload=10545]: Starting upload Aug 7 19:48:16.505235727 (10h8m38.249292587s) [upload=10545]: Done starting upload Aug 7 19:48:16.505292412 (10h8m38.249349259s) [upload=10545]: Uploading segments... Aug 7 19:48:16.505331050 (10h8m38.24938792s) [upload=10545]: Got next segment. Inline: true Aug 7 19:48:16.505335414 (10h8m38.249392261s) [upload=10545]: Waiting for error group managing segments... Aug 7 19:48:16.505371510 (10h8m38.24942837s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:48:16.505375997 (10h8m38.249432857s) [upload=10545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:48:16.505378847 (10h8m38.249435713s) [upload=10545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:48:16.678031009 (10h8m38.422087859s) [upload=10545]: Done uploading segments... Aug 7 19:48:16.678048959 (10h8m38.42210581s) [upload=10545]: Upload finished. err: <nil> Duration: 763.303379ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.....................X..] duration: 2.501940964s FAIL (2025-08-07 19:48:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== oad Aug 7 19:47:01.415199606 (10h7m23.159256469s) [upload=10523]: Uploading segments... Aug 7 19:47:01.415695790 (10h7m23.159752663s) [upload=10523]: Got next segment. Inline: false Aug 7 19:47:01.415853941 (10h7m23.159910814s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:01.415861658 (10h7m23.159918531s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:47:01.613613523 (10h7m23.357670393s) [seg_pos={0 0}, upload=10523]: Begin upload segment... Aug 7 19:47:01.613725253 (10h7m23.357782115s) [seg_pos={0 0}, upload=10523]: Done begin upload segment. Aug 7 19:47:01.613772896 (10h7m23.357829769s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.613789652 (10h7m23.357846519s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614408541 (10h7m23.358465416s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614580084 (10h7m23.358636957s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614955042 (10h7m23.359011913s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.615627191 (10h7m23.359684065s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616190198 (10h7m23.360247086s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616308606 (10h7m23.360365481s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616817087 (10h7m23.360873952s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616955702 (10h7m23.361012574s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.617641308 (10h7m23.361698186s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618552324 (10h7m23.362609201s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618638876 (10h7m23.36269575s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.619656401 (10h7m23.363713274s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.620376540 (10h7m23.364433412s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.621021271 (10h7m23.365078145s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.622173439 (10h7m23.366230312s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.623587274 (10h7m23.367644148s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:02.242265094 (10h7m23.986321948s) [upload=10523]: Next returned nil segment Aug 7 19:47:02.242286312 (10h7m23.986343178s) [upload=10523]: Waiting for error group managing segments... Aug 7 19:47:02.408548355 (10h7m24.152605206s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.432982525 (10h7m24.177039373s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.435399268 (10h7m24.17945613s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.447991738 (10h7m24.192048615s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.451951874 (10h7m24.196008728s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.458919218 (10h7m24.202976065s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.466189567 (10h7m24.210246443s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.467929013 (10h7m24.211985879s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.468659781 (10h7m24.212716634s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469273072 (10h7m24.213329936s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469966415 (10h7m24.21402327s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.494165936 (10h7m24.238222792s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.505712650 (10h7m24.249769516s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522769006 (10h7m24.266825876s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522826675 (10h7m24.266883544s) [seg_pos={0 0}, upload=10523]: Segment reached optimal threshold of 14 pieces. Aug 7 19:47:02.523183672 (10h7m24.267240551s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523298505 (10h7m24.267355356s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523509458 (10h7m24.267566331s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523763241 (10h7m24.267820119s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection Aug 7 19:47:02.523891464 (10h7m24.267948316s) [seg_pos={0 0}, upload=10523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:47:02.524080825 (10h7m24.268137697s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:47:02.524088263 (10h7m24.268145137s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:03.465799756 (10h7m25.209856627s) [upload=10523]: Done uploading segments... Aug 7 19:47:03.465870105 (10h7m25.209926954s) [upload=10523]: Upload finished. err: <nil> Duration: 2.50198108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.....................X.] duration: 2.550284013s FAIL (2025-08-07 19:47:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== oad Aug 7 19:47:01.415199606 (10h7m23.159256469s) [upload=10523]: Uploading segments... Aug 7 19:47:01.415695790 (10h7m23.159752663s) [upload=10523]: Got next segment. Inline: false Aug 7 19:47:01.415853941 (10h7m23.159910814s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:01.415861658 (10h7m23.159918531s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:47:01.613613523 (10h7m23.357670393s) [seg_pos={0 0}, upload=10523]: Begin upload segment... Aug 7 19:47:01.613725253 (10h7m23.357782115s) [seg_pos={0 0}, upload=10523]: Done begin upload segment. Aug 7 19:47:01.613772896 (10h7m23.357829769s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.613789652 (10h7m23.357846519s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614408541 (10h7m23.358465416s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614580084 (10h7m23.358636957s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614955042 (10h7m23.359011913s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.615627191 (10h7m23.359684065s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616190198 (10h7m23.360247086s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616308606 (10h7m23.360365481s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616817087 (10h7m23.360873952s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616955702 (10h7m23.361012574s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.617641308 (10h7m23.361698186s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618552324 (10h7m23.362609201s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618638876 (10h7m23.36269575s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.619656401 (10h7m23.363713274s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.620376540 (10h7m23.364433412s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.621021271 (10h7m23.365078145s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.622173439 (10h7m23.366230312s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.623587274 (10h7m23.367644148s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:02.242265094 (10h7m23.986321948s) [upload=10523]: Next returned nil segment Aug 7 19:47:02.242286312 (10h7m23.986343178s) [upload=10523]: Waiting for error group managing segments... Aug 7 19:47:02.408548355 (10h7m24.152605206s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.432982525 (10h7m24.177039373s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.435399268 (10h7m24.17945613s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.447991738 (10h7m24.192048615s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.451951874 (10h7m24.196008728s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.458919218 (10h7m24.202976065s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.466189567 (10h7m24.210246443s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.467929013 (10h7m24.211985879s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.468659781 (10h7m24.212716634s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469273072 (10h7m24.213329936s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469966415 (10h7m24.21402327s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.494165936 (10h7m24.238222792s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.505712650 (10h7m24.249769516s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522769006 (10h7m24.266825876s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522826675 (10h7m24.266883544s) [seg_pos={0 0}, upload=10523]: Segment reached optimal threshold of 14 pieces. Aug 7 19:47:02.523183672 (10h7m24.267240551s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523298505 (10h7m24.267355356s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523509458 (10h7m24.267566331s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523763241 (10h7m24.267820119s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection Aug 7 19:47:02.523891464 (10h7m24.267948316s) [seg_pos={0 0}, upload=10523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:47:02.524080825 (10h7m24.268137697s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:47:02.524088263 (10h7m24.268145137s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:03.465799756 (10h7m25.209856627s) [upload=10523]: Done uploading segments... Aug 7 19:47:03.465870105 (10h7m25.209926954s) [upload=10523]: Upload finished. err: <nil> Duration: 2.550320769s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...............................X..................] duration: 860.825492ms FAIL (2025-08-07 19:47:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 860.857074ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.....................X] duration: 2.552787694s FAIL (2025-08-07 19:47:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== oad Aug 7 19:47:01.415199606 (10h7m23.159256469s) [upload=10523]: Uploading segments... Aug 7 19:47:01.415695790 (10h7m23.159752663s) [upload=10523]: Got next segment. Inline: false Aug 7 19:47:01.415853941 (10h7m23.159910814s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:47:01.415861658 (10h7m23.159918531s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:47:01.613613523 (10h7m23.357670393s) [seg_pos={0 0}, upload=10523]: Begin upload segment... Aug 7 19:47:01.613725253 (10h7m23.357782115s) [seg_pos={0 0}, upload=10523]: Done begin upload segment. Aug 7 19:47:01.613772896 (10h7m23.357829769s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.613789652 (10h7m23.357846519s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614408541 (10h7m23.358465416s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614580084 (10h7m23.358636957s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.614955042 (10h7m23.359011913s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.615627191 (10h7m23.359684065s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616190198 (10h7m23.360247086s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616308606 (10h7m23.360365481s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616817087 (10h7m23.360873952s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.616955702 (10h7m23.361012574s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.617641308 (10h7m23.361698186s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618552324 (10h7m23.362609201s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.618638876 (10h7m23.36269575s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.619656401 (10h7m23.363713274s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.620376540 (10h7m23.364433412s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.621021271 (10h7m23.365078145s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.622173439 (10h7m23.366230312s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:01.623587274 (10h7m23.367644148s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Uploading piece... Aug 7 19:47:02.242265094 (10h7m23.986321948s) [upload=10523]: Next returned nil segment Aug 7 19:47:02.242286312 (10h7m23.986343178s) [upload=10523]: Waiting for error group managing segments... Aug 7 19:47:02.408548355 (10h7m24.152605206s) [noise=true , address=104.36.82.22:4538 , piece_id=2A7MWSNBXZRIVBG5WWNH662BVWMDDON5CTBCTUM4NPUIXEFLHADQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.432982525 (10h7m24.177039373s) [noise=true , address=104.36.82.47:4545 , piece_id=AQCNAHEEGPB6YXJBCWPQP5R4SM7OMIR4BSQEWA3RDEJLOAXOU5PA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.435399268 (10h7m24.17945613s) [noise=true , address=104.36.82.3:4785 , piece_id=UCN46ZQDTUSCZXKZQKDVVXXOS4OGXRNH37LKUT3LQE5ACIJTLGNA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.447991738 (10h7m24.192048615s) [noise=true , address=104.36.82.4:4817 , piece_id=EYQQF4CZHYPMKZ6J2D5EOJMPY22FICTNSFJAC5FZKN6OGALOMGXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.451951874 (10h7m24.196008728s) [noise=true , address=104.36.82.11:4137 , piece_id=EDIKANMLNJH5R4ZFEAKUSM7YIYXJOG3MSIJG6XOLM53ECDUNUQXA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.458919218 (10h7m24.202976065s) [noise=true , address=104.36.82.16:4324 , piece_id=SPWM63ZX3ZYL3ZMB2OENMDJAAGA6W3PQXBZVWTKPMA2N7KGARE6A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.466189567 (10h7m24.210246443s) [noise=true , address=104.36.82.44:4877 , piece_id=QWPM2DJL3VMGRNSON7OETCCOZEINPPRH5GPWDQZLFSUQ5CI4FNJA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.467929013 (10h7m24.211985879s) [noise=true , address=104.36.82.5:4842 , piece_id=AYTQCMQ2K6PKP6WJZZAENMNUI2O6HX4HSLG5K55GIEMQA2IOE25A, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.468659781 (10h7m24.212716634s) [noise=true , address=104.36.82.52:4107 , piece_id=JIRLFFW3FM6UFFBLACZKY5L56XEMQ7O3NIBGIHKUP75GBETCSN7Q, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469273072 (10h7m24.213329936s) [noise=true , address=104.36.82.34:4564 , piece_id=J22ZEQ4WSUX2OXKYPAYHIYPOCWHT7UL7BXVAYLH2BCKJI65ILEQA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.469966415 (10h7m24.21402327s) [noise=true , address=45.91.116.13:4166 , piece_id=BZ4QFR7WUARYOVEZKSDVRIIJ3J74ARJXHN22VBDTPKBUZ5F5BMBA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.494165936 (10h7m24.238222792s) [noise=true , address=104.36.82.37:4667 , piece_id=7ALUVMGSXUH3375VQ5JSFJ5SQM3CGRNQQGPVP6NUIR3U42QSLGUA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.505712650 (10h7m24.249769516s) [noise=true , address=45.91.116.14:4211 , piece_id=ENFIE7AXUJIK5IINJGH6FR7L5U5L5D2ACSHH27JQYO7JSG7ADKAA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522769006 (10h7m24.266825876s) [noise=true , address=104.36.82.60:4360 , piece_id=GX3CNZU5P5BDQIYXLB5232MAQQGEDEFAQJ3FHY5DOKAE5VOCM4OA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: <nil> Aug 7 19:47:02.522826675 (10h7m24.266883544s) [seg_pos={0 0}, upload=10523]: Segment reached optimal threshold of 14 pieces. Aug 7 19:47:02.523183672 (10h7m24.267240551s) [noise=true , address=104.36.82.46:4490 , piece_id=44L23EHAX5KWHDOACEBA3WHBV7LKDBJ2GNFT4JDIHZO5V5O7ABYQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PUxwz3cZkF8e2VkjTXnu1utrFzQRTxdohfd9EvDaLvyejpTji): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523298505 (10h7m24.267355356s) [noise=true , address=104.36.82.60:4346 , piece_id=HCQXSVLXOAFXAQSFYYNMFZBVXG6A7BSP2CNU64LBF3TZH2BYZNTA, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523509458 (10h7m24.267566331s) [noise=true , address=104.36.82.54:4186 , piece_id=DIBZA3OWCACKT3YLEAPNAOCXEKZATIPPM5YRMJMMTK6MWXYZY2WQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Gu3vXy2JUkKDaF4MkMCgVmYspW4Ez8EAfv6e4GeCkrwYTe5T): protocol: expected piece hash; context canceled; EOF Aug 7 19:47:02.523763241 (10h7m24.267820119s) [noise=true , address=64.49.13.26:4947 , piece_id=FDXOKMQQ5OC6YDUL5JSJME2RQ5WWWMKONMRT2YXUH7FMJ2YGHREQ, seg_pos={0 0}, upload=10523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1soiTQsiMNe5BkNHwwAGykmtP9LtLxncqE7Tv728ak8pjFeshg): protocol: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36364->64.49.13.26:4947: use of closed network connection Aug 7 19:47:02.523891464 (10h7m24.267948316s) [seg_pos={0 0}, upload=10523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:47:02.524080825 (10h7m24.268137697s) [upload=10523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:47:02.524088263 (10h7m24.268145137s) [upload=10523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:47:03.465799756 (10h7m25.209856627s) [upload=10523]: Done uploading segments... Aug 7 19:47:03.465870105 (10h7m25.209926954s) [upload=10523]: Upload finished. err: <nil> Duration: 2.552826892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...............................X.................] duration: 1.090710733s FAIL (2025-08-07 19:46:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 1.09076891s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...............................X................] duration: 863.263305ms FAIL (2025-08-07 19:46:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 863.308545ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...............................X...............] duration: 861.220618ms FAIL (2025-08-07 19:46:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 861.247613ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.747960991s FAIL (2025-08-07 19:45:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.747997284s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...............................X..............] duration: 1.048691774s FAIL (2025-08-07 19:45:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 1.048727613s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.834509212s FAIL (2025-08-07 19:45:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.834547632s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.773213488s FAIL (2025-08-07 19:44:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.773250668s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...............................X.............] duration: 829.801476ms FAIL (2025-08-07 19:44:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 829.827488ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.589540339s FAIL (2025-08-07 19:43:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.589577215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...............................X............] duration: 859.419435ms FAIL (2025-08-07 19:43:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 859.457926ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.442233167s FAIL (2025-08-07 19:43:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.442258371s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...............................X...........] duration: 1.025412964s FAIL (2025-08-07 19:42:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 1.025441519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.309324091s FAIL (2025-08-07 19:42:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.309359569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...............................X..........] duration: 845.437499ms FAIL (2025-08-07 19:42:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 845.47032ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.913973616s FAIL (2025-08-07 19:41:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.913997696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...............................X.........] duration: 875.575618ms FAIL (2025-08-07 19:41:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 875.618713ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.427573877s FAIL (2025-08-07 19:40:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.427614199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...............................X........] duration: 978.643829ms FAIL (2025-08-07 19:40:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 978.673028ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)