Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.....X.........................X........] duration: 2.963246002s FAIL (2025-08-13 03:07:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.963275518s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 867.489891ms FAIL (2025-08-13 03:06:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 867.54068ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.228766431s FAIL (2025-08-13 03:06:47 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.228795317s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000882441s FAIL (2025-08-13 03:06:36 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.001006461s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.....X.........................X.......] duration: 3.592105535s FAIL (2025-08-13 03:06:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 3.592217441s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 860.764178ms FAIL (2025-08-13 03:05:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 860.826986ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.....X.........................X......] duration: 2.596127904s FAIL (2025-08-13 03:05:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.596159978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 880.370217ms FAIL (2025-08-13 03:05:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 880.402388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X.....X.........................X.....] duration: 2.446485582s FAIL (2025-08-13 03:05:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.446513593s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 847.56131ms FAIL (2025-08-13 03:04:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 847.586931ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.....X.........................X....] duration: 2.393026745s FAIL (2025-08-13 03:04:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.393065099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X.....X.........................X...] duration: 2.545888158s FAIL (2025-08-13 03:03:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.545930089s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.069786239s FAIL (2025-08-13 03:03:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.069825959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.....X.........................X..] duration: 2.39407868s FAIL (2025-08-13 03:03:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.394119667s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 871.145268ms FAIL (2025-08-13 03:02:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 871.219012ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 854.884435ms FAIL (2025-08-13 03:02:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 854.968446ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.....X.........................X.] duration: 2.563751834s FAIL (2025-08-13 03:02:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 2.563776017s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 897.539077ms FAIL (2025-08-13 03:02:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 897.626453ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 834.886698ms FAIL (2025-08-13 03:01:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 834.912029ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 885.768321ms FAIL (2025-08-13 03:01:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 885.815521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.....X.........................X] duration: 1.786868206s FAIL (2025-08-13 03:01:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 03:01:07.324078865 (105h35m29.283176117s) [upload=110035]: Starting upload Aug 13 03:01:07.324161548 (105h35m29.2832588s) [upload=110035]: Done starting upload Aug 13 03:01:07.324301895 (105h35m29.283399147s) [upload=110035]: Uploading segments... Aug 13 03:01:07.324590702 (105h35m29.28368795s) [upload=110035]: Got next segment. Inline: false Aug 13 03:01:07.324640625 (105h35m29.283737875s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:01:07.324647395 (105h35m29.283744647s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:01:07.523013764 (105h35m29.482111012s) [seg_pos={0 0}, upload=110035]: Begin upload segment... Aug 13 03:01:07.523095084 (105h35m29.482192333s) [seg_pos={0 0}, upload=110035]: Done begin upload segment. Aug 13 03:01:07.523135576 (105h35m29.482232823s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523161239 (105h35m29.482258515s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523235814 (105h35m29.482333065s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523751977 (105h35m29.482849235s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.523764089 (105h35m29.482861329s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524291478 (105h35m29.483388727s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524306705 (105h35m29.483403958s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.524781791 (105h35m29.483879043s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525182137 (105h35m29.484279397s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525454553 (105h35m29.484551811s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525963455 (105h35m29.485060714s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.525977802 (105h35m29.485075052s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.526515558 (105h35m29.485613072s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.527066456 (105h35m29.48616371s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.528787690 (105h35m29.487884931s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.531375686 (105h35m29.490472944s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.532102477 (105h35m29.491199789s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:07.533620774 (105h35m29.492718018s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Uploading piece... Aug 13 03:01:08.107167740 (105h35m30.066264998s) [upload=110035]: Next returned nil segment Aug 13 03:01:08.107193859 (105h35m30.066291118s) [upload=110035]: Waiting for error group managing segments... Aug 13 03:01:08.257016648 (105h35m30.21611388s) [noise=true , address=104.36.82.61:4386 , piece_id=76OQHOKSI7FN47RTWGKZ2B6TQJGOKZDTM4D3AEWVB7EPT42JTEHA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.259450307 (105h35m30.218547548s) [noise=true , address=104.36.82.35:4604 , piece_id=S62DSUJTELOEZXNE64VIC4PTMPYTSQAUH53KEATSXPZQ5JQ3J3LA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269154763 (105h35m30.228252013s) [noise=true , address=77.90.31.19:4876 , piece_id=S25ZJZ7HA624R6H6ESQCCXP4HQQC5XFQVESK4R2O5PMJ4SSE4Q4A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.269945637 (105h35m30.229042886s) [noise=true , address=104.36.82.8:4976 , piece_id=O5PJ67DNNAJA67QK5G4YXDPQQLFFPR2OUEAZV7SBEDX2DJLJ2XVQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.270725133 (105h35m30.22982237s) [noise=true , address=104.36.82.47:4552 , piece_id=OB5EWLAWQFNUJ4XA7J35KU7KFI2NRXDRJSL3MYL5TEQORE3CEQZQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.280663892 (105h35m30.239761139s) [noise=true , address=104.36.82.36:4625 , piece_id=SBVVNNA7JYCILTF4WKMGZCD235LFTOPXX2WMK3Y3MDWQLA4KAIDQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.282553124 (105h35m30.241650367s) [noise=true , address=77.90.31.16:4742 , piece_id=RNQTGEJCCWIB4ZS5VW3EGZXWWSKXT2WVLW3ZUPSQP4EZZUFPW3FA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.288742015 (105h35m30.247839262s) [noise=true , address=104.36.82.43:4861 , piece_id=RJIGDGJI4LKUGPEOIGDAXI73KKMVF62WHPSLO6DWPQUWWHIP5I7A, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.298156569 (105h35m30.257253802s) [noise=true , address=104.36.82.46:4502 , piece_id=NHVUVDYP6RXKPHHTUYERXU4JOAKZEC7FNKOG2O3CZTGZRLXDZNLA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304051020 (105h35m30.263148271s) [noise=true , address=104.36.82.59:4307 , piece_id=5RADVSLZ5BBHXT5LVZPURXMQ6NNZYXZMQH52PAGG3BV3C6INQFGQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.304328414 (105h35m30.263425656s) [noise=true , address=77.90.31.10:4522 , piece_id=KN2L5NKBTAE3Z6MFY7E563CLVN3MXTJDXXDCLLT4U7CUR6LDLMUQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.305131340 (105h35m30.264228589s) [noise=true , address=104.36.82.18:4366 , piece_id=R7F2L37VB3ET6U4G75ONMQFWINUT3FCGEZMZ42ZJ2OMJT6N6BMKA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.322564466 (105h35m30.281661706s) [noise=true , address=104.36.82.44:4904 , piece_id=DJYOBCHAYUSR3XRLGTQMLZCP7PIPQ5FFE5FNMOIJL4MUJ3RTCURA, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378277685 (105h35m30.337374932s) [noise=true , address=104.36.82.23:4446 , piece_id=RRAWVUIM76U2FR5JHQ6IJW3KZU2E7LD6444O52Z5NSPATV5VHU3Q, seg_pos={0 0}, upload=110035]: Done uploading piece. err: <nil> Aug 13 03:01:08.378310301 (105h35m30.337407548s) [seg_pos={0 0}, upload=110035]: Segment reached optimal threshold of 14 pieces. Aug 13 03:01:08.378586061 (105h35m30.337683307s) [noise=true , address=79.127.219.38:4005 , piece_id=AWDZCNNUJFLUWRCWZFUNJJGC2FPVPDEF6MC6E4WTI536XA4EI5JQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mBZcyW4fP1CSMiLhmb6uL6fxWae6DUoMg25mnprDVTBaxwPFp): protocol: expected piece hash; context canceled; EOF Aug 13 03:01:08.378633909 (105h35m30.337731156s) [noise=true , address=64.49.13.169:4710 , piece_id=TEPU4MEUDUVSI3WTEMZLOEOO6YPNENSIWVTHNENUOCADSD7VYOPQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35130->64.49.13.169:4710: use of closed network connection Aug 13 03:01:08.378780886 (105h35m30.337878138s) [noise=true , address=66.23.193.175:4556 , piece_id=ZG7DWTD5YGLINAC77FQRXCFLM2CAVL7SGZCDGZXWYQWPUYDDMBHQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59866->66.23.193.175:4556: use of closed network connection Aug 13 03:01:08.378825113 (105h35m30.337922359s) [noise=true , address=64.49.13.169:4714 , piece_id=OEPZOS5W5MZVZ6T2J5G2PWMO2NHPOX3EHBZH35CTM4IGEPAEWMBQ, seg_pos={0 0}, upload=110035]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33724->64.49.13.169:4714: use of closed network connection Aug 13 03:01:08.378855270 (105h35m30.337952505s) [seg_pos={0 0}, upload=110035]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:01:08.378944658 (105h35m30.338041905s) [upload=110035]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:01:08.378951943 (105h35m30.338049195s) [upload=110035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:01:08.546269786 (105h35m30.505367023s) [upload=110035]: Done uploading segments... Aug 13 03:01:08.546291757 (105h35m30.505388993s) [upload=110035]: Upload finished. err: <nil> Duration: 1.786963952s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 858.805704ms FAIL (2025-08-13 03:00:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 858.860776ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 874.595207ms FAIL (2025-08-13 03:00:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 874.696714ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X.....X.........................] duration: 2.47289786s FAIL (2025-08-13 03:00:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.472952094s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 881.646984ms FAIL (2025-08-13 02:59:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 881.678605ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.....X........................] duration: 2.350012118s FAIL (2025-08-13 02:59:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.350042591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.....X.......................] duration: 2.479779441s FAIL (2025-08-13 02:59:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.479815111s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 859.811668ms FAIL (2025-08-13 02:58:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 859.907129ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.....X......................] duration: 2.455115671s FAIL (2025-08-13 02:58:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.45514708s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.032073079s FAIL (2025-08-13 02:58:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.032105927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 831.720206ms FAIL (2025-08-13 02:57:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 831.751205ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...............................X.....X.....................] duration: 2.349262832s FAIL (2025-08-13 02:57:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.349298657s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.014017637s FAIL (2025-08-13 02:57:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.01404923s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...............................X.....X....................] duration: 2.518790427s FAIL (2025-08-13 02:56:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.518839512s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 822.318352ms FAIL (2025-08-13 02:56:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 822.365118ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...............................X.....X...................] duration: 2.443125672s FAIL (2025-08-13 02:56:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.443158856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 820.045792ms FAIL (2025-08-13 02:55:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 820.075554ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...............................X.....X..................] duration: 2.766039355s FAIL (2025-08-13 02:55:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.766068572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X........................X..................................] duration: 818.816236ms FAIL (2025-08-13 02:54:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 818.845855ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...............................X.....X.................] duration: 2.35841887s FAIL (2025-08-13 02:54:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.358451618s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X........................X.................................] duration: 844.137432ms FAIL (2025-08-13 02:54:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 844.200978ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............................X.....X................] duration: 2.418951436s FAIL (2025-08-13 02:54:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.418989839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.X........................X................................] duration: 1.044464733s FAIL (2025-08-13 02:53:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.044501484s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.X........................X...............................] duration: 884.152512ms FAIL (2025-08-13 02:53:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 884.18564ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...............................X.....X...............] duration: 2.417649116s FAIL (2025-08-13 02:53:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.4176804s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X.X........................X..............................] duration: 841.933054ms FAIL (2025-08-13 02:52:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 841.962191ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...............................X.....X..............] duration: 2.464842215s FAIL (2025-08-13 02:52:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.464876267s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X.X........................X.............................] duration: 882.772871ms FAIL (2025-08-13 02:51:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 882.829699ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X.X........................X............................] duration: 903.722904ms FAIL (2025-08-13 02:51:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 903.75497ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...............................X.....X.............] duration: 2.884191276s FAIL (2025-08-13 02:51:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests Duration: 2.884224159s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)