Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.393167076s FAIL (2025-08-10 09:57:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.393208666s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.40802699s FAIL (2025-08-10 09:56:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.408123837s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 816.618999ms FAIL (2025-08-10 09:56:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 816.647962ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 855.02014ms FAIL (2025-08-10 09:55:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.043628ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.347986531s FAIL (2025-08-10 09:55:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.348016201s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 809.752287ms FAIL (2025-08-10 09:55:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 809.79235ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.344852593s FAIL (2025-08-10 09:54:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.344953827s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 848.58824ms FAIL (2025-08-10 09:54:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 848.616005ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.388376174s FAIL (2025-08-10 09:54:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.388398269s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.353984684s FAIL (2025-08-10 09:53:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.354015004s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 923.270242ms FAIL (2025-08-10 09:53:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 923.297786ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 841.978951ms FAIL (2025-08-10 09:53:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 842.009293ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.343611315s FAIL (2025-08-10 09:53:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.343640418s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 846.192041ms FAIL (2025-08-10 09:53:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 846.24115ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.580263477s FAIL (2025-08-10 09:53:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.58029315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.346148151s FAIL (2025-08-10 09:52:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.346176802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.020196576s FAIL (2025-08-10 09:52:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.02023582s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.407166652s FAIL (2025-08-10 09:52:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.407197797s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 842.109511ms FAIL (2025-08-10 09:51:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 842.145933ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.358762534s FAIL (2025-08-10 09:51:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.358792669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X........................................................X..] duration: 2.851241679s FAIL (2025-08-10 09:50:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.8512746s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 815.783371ms FAIL (2025-08-10 09:50:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 815.813127ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X........................................................X.] duration: 2.440810252s FAIL (2025-08-10 09:50:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.440868488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 848.755511ms FAIL (2025-08-10 09:49:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 848.780706ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X........................................................X] duration: 2.475069839s FAIL (2025-08-10 09:49:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments... Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment... Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment. Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece... Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments... Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil> Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces. Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments... Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil> Duration: 2.475171482s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 944.433522ms FAIL (2025-08-10 09:49:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 944.493614ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 815.836631ms FAIL (2025-08-10 09:48:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 815.863285ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.451188099s FAIL (2025-08-10 09:48:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.451220415s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 826.053828ms FAIL (2025-08-10 09:48:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 826.093774ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.436124218s FAIL (2025-08-10 09:47:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.436232636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 841.906657ms FAIL (2025-08-10 09:47:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 841.952626ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.34927039s FAIL (2025-08-10 09:46:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.349300867s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 862.192663ms FAIL (2025-08-10 09:46:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 862.217192ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.573643159s FAIL (2025-08-10 09:46:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.573669897s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.402558249s FAIL (2025-08-10 09:45:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.402593363s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.004999807s FAIL (2025-08-10 09:45:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.005032831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.390969114s FAIL (2025-08-10 09:45:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.391001709s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.082114116s FAIL (2025-08-10 09:45:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.08214187s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.346573623s FAIL (2025-08-10 09:45:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.34660252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 944.197707ms FAIL (2025-08-10 09:44:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 944.225563ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 831.276565ms FAIL (2025-08-10 09:44:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 831.307557ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.425767352s FAIL (2025-08-10 09:43:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.425799205s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 882.811586ms FAIL (2025-08-10 09:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 882.843599ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.337371252s FAIL (2025-08-10 09:43:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.337407849s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 813.027162ms FAIL (2025-08-10 09:42:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 813.058169ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 854.175125ms FAIL (2025-08-10 09:42:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 854.200854ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.358826157s FAIL (2025-08-10 09:42:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.358857744s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 831.713083ms FAIL (2025-08-10 09:42:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 831.75778ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.323605665s FAIL (2025-08-10 09:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 45e1bee41c3217d76ae36e2322d947982e77e4e80f42c60b6005ed7b1a52d95d != before 2ab9f24d72be2324bb851a0acd94be4b856c3b2506ee92fd5bbfcf8f6fcd4835 ======LOGS====== Aug 10 09:09:46.861949195 (39h44m8.821046447s) [upload=41407]: Starting upload Aug 10 09:09:46.862013303 (39h44m8.82111054s) [upload=41407]: Done starting upload Aug 10 09:09:46.862094128 (39h44m8.821191374s) [upload=41407]: Uploading segments... Aug 10 09:09:46.862319238 (39h44m8.821416484s) [upload=41407]: Got next segment. Inline: false Aug 10 09:09:46.862359484 (39h44m8.821456731s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:09:46.862364576 (39h44m8.821461823s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 09:09:47.064307590 (39h44m9.023404838s) [seg_pos={0 0}, upload=41407]: Begin upload segment... Aug 10 09:09:47.064376498 (39h44m9.023473732s) [seg_pos={0 0}, upload=41407]: Done begin upload segment. Aug 10 09:09:47.064429168 (39h44m9.023526418s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.064619301 (39h44m9.023716557s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065474991 (39h44m9.024572246s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.065685665 (39h44m9.024782914s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.066542773 (39h44m9.025640022s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067234108 (39h44m9.026331362s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.067680678 (39h44m9.026777932s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068060123 (39h44m9.027157369s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.068404684 (39h44m9.027501939s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069238173 (39h44m9.028335426s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069617694 (39h44m9.028714941s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.069950898 (39h44m9.029048143s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.072224279 (39h44m9.031321527s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.079618036 (39h44m9.038715284s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.081875627 (39h44m9.040972882s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.083834626 (39h44m9.042931872s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.089019138 (39h44m9.048116394s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.093419324 (39h44m9.05251658s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Uploading piece... Aug 10 09:09:47.651589634 (39h44m9.610686872s) [upload=41407]: Next returned nil segment Aug 10 09:09:47.651609639 (39h44m9.610706887s) [upload=41407]: Waiting for error group managing segments... Aug 10 09:09:47.808945478 (39h44m9.768042724s) [noise=true , address=104.36.82.61:4406 , piece_id=E4HCNXBYMIVDMFHTSXMDRSISGOFLMT2WLSE5ZSSPPVPB6FBKUGWA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.809599663 (39h44m9.768696908s) [noise=true , address=104.36.82.3:4784 , piece_id=7ZE25P7AMEY5MBWLZO4MJ5KAAWSVM6DSOMWBQYTE2A54Y6O65F7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812220644 (39h44m9.77131789s) [noise=true , address=104.36.82.62:4433 , piece_id=MHQY7UIKUSXBSBGPXBUEBANGBE4JWUNXITJJFNW5TSDAHXE5IVHA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812298444 (39h44m9.7713957s) [noise=true , address=104.36.82.58:4275 , piece_id=C3XEOAVJPGTX5H4W2RPD54PJRKDKNRS4GHPPDBRKOXPGWBUFZN2A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.812814749 (39h44m9.771911986s) [noise=true , address=104.36.82.14:4242 , piece_id=IGTFN2SVWNOQGYMJO3JRMES5IQGSD2P7UTT4KK4TYEQWNKY2EOMQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.813429113 (39h44m9.77252636s) [noise=true , address=104.36.82.61:4391 , piece_id=D67EXF22PDFOGVNYMFMJNWRQP5TMTPRJTBRAQIUNHKCK2HWHEWZA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.814466530 (39h44m9.773563778s) [noise=true , address=104.36.82.38:4692 , piece_id=TBHDTKW43OGVV3DGORQWBNWIJ6PF4656GVPIYCEDF63LMNATFKEQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.816375334 (39h44m9.775472579s) [noise=true , address=104.36.82.39:4729 , piece_id=WHDSZ4RTGB7CHQB5MZXXDNZGPGRGXKPF5ZNGNMVLUQ7WVOHM2U5Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817426795 (39h44m9.776524033s) [noise=true , address=104.36.82.21:4486 , piece_id=3AFHD5DA2Y6DKAF3E6QBXSMD32VESB35V3XAYFCDLE2H3EU63SCA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.817609083 (39h44m9.776706322s) [noise=true , address=104.36.82.60:4353 , piece_id=2GBV4FJULNAQNGNFUIKQLBUK2KP6ZGTDRMAMWPFHWS3CJO63AA4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818048947 (39h44m9.777146185s) [noise=true , address=104.36.82.8:4001 , piece_id=UMRPXPGVBCTQJCLOUYZSV4AWMZQC5HHAVBV7GVB3F4G2O4MLVRMA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.818941734 (39h44m9.778038965s) [noise=true , address=104.36.82.44:4875 , piece_id=BZY4IJHVKQYY6Z5QXCB2A2Z4HGZPMO5XNMG4M6XR2GL5FRUCTOHQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823492518 (39h44m9.782589757s) [noise=true , address=104.36.82.36:4646 , piece_id=PP3IZ3PVJFCVB4SBFQT3OMSNFNCZHUHPGQLOL27EJDW7C6YQHXYA, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823828878 (39h44m9.782926108s) [noise=true , address=104.36.82.12:4161 , piece_id=JGSXFRPA2U5HZ4AC773HD3AU633USWGDNZX2OMMB5ZQ5TB22LX4Q, seg_pos={0 0}, upload=41407]: Done uploading piece. err: <nil> Aug 10 09:09:47.823862829 (39h44m9.782960075s) [seg_pos={0 0}, upload=41407]: Segment reached optimal threshold of 14 pieces. Aug 10 09:09:47.824258207 (39h44m9.783355441s) [noise=true , address=104.36.82.23:4447 , piece_id=MQGXE57SMXN26BRAHEC5NYHBEO45J4NVX7BGEDTIFDTDBGP6H53A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824361267 (39h44m9.783458499s) [noise=true , address=193.149.164.143:4693 , piece_id=FHGSY7ABF4UNRHYOXWZYYJJFSV6Y3THVDATIOZI4VR5FWSPL7SFQ, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47706->193.149.164.143:4693: use of closed network connection Aug 10 09:09:47.824391804 (39h44m9.783489035s) [noise=true , address=64.49.13.27:4958 , piece_id=QJ77PZVZFLBXGGWQCEIGS6X5UE3QI2JQ57AT7ITJCR736WMIZN7A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmqDfLfXDjJ6Bo9PAYiVgshEBPnfQ1D9yC6CcvXpPRCWq4Wrs): protocol: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42984->64.49.13.27:4958: use of closed network connection Aug 10 09:09:47.824468330 (39h44m9.783565575s) [noise=true , address=104.36.82.7:4935 , piece_id=BT3BLBTCAF4NTXR433CTDSTABXIWYYEVPIX4TEJNJREEVBNUJV3A, seg_pos={0 0}, upload=41407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17YmVUymv5Cx9wFw1g67CfEHxg8B75TcFkTCRpNdTm2PHanHVJ): protocol: expected piece hash; context canceled; EOF Aug 10 09:09:47.824482475 (39h44m9.783579707s) [seg_pos={0 0}, upload=41407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 09:09:47.824564144 (39h44m9.783661376s) [upload=41407]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 09:09:47.824568864 (39h44m9.783666109s) [upload=41407]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:09:47.967563413 (39h44m9.926660659s) [upload=41407]: Done uploading segments... Aug 10 09:09:47.967585657 (39h44m9.926682896s) [upload=41407]: Upload finished. err: <nil> Duration: 2.323678023s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 847.412769ms FAIL (2025-08-10 09:41:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests Duration:* 847.444923ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)