Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.405908496s
FAIL (2025-08-10 10:17:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.405942427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.047207451s
FAIL (2025-08-10 10:17:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.047266517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.358372288s
FAIL (2025-08-10 10:16:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.358410186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
853.004537ms
FAIL (2025-08-10 10:16:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.034992ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.439560171s
FAIL (2025-08-10 10:16:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.439590797s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.008186362s
FAIL (2025-08-10 10:15:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.008214035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
894.236452ms
FAIL (2025-08-10 10:15:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 894.266491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.384240561s
FAIL (2025-08-10 10:15:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.384286258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.021940808s
FAIL (2025-08-10 10:14:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.021996986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.277529618s
FAIL (2025-08-10 10:14:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.277568248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.108405737s
FAIL (2025-08-10 10:13:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.108435362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.364083164s
FAIL (2025-08-10 10:13:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.364121249s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.319220327s
FAIL (2025-08-10 10:12:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.319290288s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
824.219427ms
FAIL (2025-08-10 10:12:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.246482ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.026043344s
FAIL (2025-08-10 10:12:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.026100384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
857.318785ms
FAIL (2025-08-10 10:11:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.428539ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.231450597s
FAIL (2025-08-10 10:11:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.231485147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.40631959s
FAIL (2025-08-10 10:11:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.406392586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
908.939192ms
FAIL (2025-08-10 10:10:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.981853ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.305100893s
FAIL (2025-08-10 10:10:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.305135954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
828.26241ms
FAIL (2025-08-10 10:10:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.293017ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.776987034s
FAIL (2025-08-10 10:09:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.777015212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
862.208963ms
FAIL (2025-08-10 10:09:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.257889ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.364948736s
FAIL (2025-08-10 10:09:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.36497664s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.486484352s
FAIL (2025-08-10 10:08:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.486531127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
910.272165ms
FAIL (2025-08-10 10:08:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 910.303534ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.266379671s
FAIL (2025-08-10 10:07:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.26642162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
857.883457ms
FAIL (2025-08-10 10:07:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.923848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.531505206s
FAIL (2025-08-10 10:06:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.531536667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
832.137788ms
FAIL (2025-08-10 10:06:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.190873ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
836.868835ms
FAIL (2025-08-10 10:05:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.916321ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.366454495s
FAIL (2025-08-10 10:05:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.366490311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.219172092s
FAIL (2025-08-10 10:04:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.21920823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.388077025s
FAIL (2025-08-10 10:04:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.388105462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.437575236s
FAIL (2025-08-10 10:04:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.43769335s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
835.524126ms
FAIL (2025-08-10 10:03:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.558183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.059132164s
FAIL (2025-08-10 10:03:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.059175284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.341810335s
FAIL (2025-08-10 10:02:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.341845319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
854.353128ms
FAIL (2025-08-10 10:02:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.395544ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.324923018s
FAIL (2025-08-10 10:01:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.32497809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
851.462971ms
FAIL (2025-08-10 10:01:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.559062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.412147649s
FAIL (2025-08-10 10:00:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.412208222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
839.217182ms
FAIL (2025-08-10 10:00:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.248089ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
825.320656ms
FAIL (2025-08-10 09:59:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.351595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.274500413s
FAIL (2025-08-10 09:59:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.274531785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
986.205381ms
FAIL (2025-08-10 09:58:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 986.234224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.305480615s
FAIL (2025-08-10 09:58:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.305508422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.326057364s
FAIL (2025-08-10 09:57:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.326088309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
828.746927ms
FAIL (2025-08-10 09:57:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.78913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
832.075056ms
FAIL (2025-08-10 09:57:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.104125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|