Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 917.452566ms FAIL (2025-08-10 02:10:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 917.487094ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 922.40347ms FAIL (2025-08-10 02:10:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 922.446049ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.565135066s FAIL (2025-08-10 02:09:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.565165288s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.053837221s FAIL (2025-08-10 02:09:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.053865489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 915.173239ms FAIL (2025-08-10 02:08:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 915.283668ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.38230434s FAIL (2025-08-10 02:08:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.382340082s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 836.469704ms FAIL (2025-08-10 02:08:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 836.495415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 846.741343ms FAIL (2025-08-10 02:08:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 846.834876ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.491769714s FAIL (2025-08-10 02:07:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.49180784s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 981.635814ms FAIL (2025-08-10 02:07:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 981.771102ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.485021499s FAIL (2025-08-10 02:06:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.485051128s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 830.136172ms FAIL (2025-08-10 02:06:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 830.180608ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.494764716s FAIL (2025-08-10 02:06:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.494803007s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 970.013961ms FAIL (2025-08-10 02:05:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 970.052694ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.387759636s FAIL (2025-08-10 02:05:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.387787782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.419287797s FAIL (2025-08-10 02:05:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.41933652s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 828.449692ms FAIL (2025-08-10 02:04:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 828.479174ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.414406338s FAIL (2025-08-10 02:04:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.414436262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.541188127s FAIL (2025-08-10 02:04:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.54122228s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 829.016737ms FAIL (2025-08-10 02:03:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 829.121142ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.459319171s FAIL (2025-08-10 02:03:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.459367308s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 850.669928ms FAIL (2025-08-10 02:02:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.701662ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.448352539s FAIL (2025-08-10 02:02:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.448388969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 849.899728ms FAIL (2025-08-10 02:01:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.036757ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.404408932s FAIL (2025-08-10 02:01:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.404445188s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 890.697004ms FAIL (2025-08-10 02:01:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 890.753384ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.500890914s FAIL (2025-08-10 02:00:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.500920697s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 969.116319ms FAIL (2025-08-10 02:00:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 969.145715ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...........................X...............................] duration: 2.407403063s FAIL (2025-08-10 02:00:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.407468332s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 976.972127ms FAIL (2025-08-10 01:59:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 977.000775ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 887.567424ms FAIL (2025-08-10 01:59:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 887.593965ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X...........................X..............................] duration: 2.566303802s FAIL (2025-08-10 01:59:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.566336122s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 834.216583ms FAIL (2025-08-10 01:58:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 834.253203ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X...........................X.............................] duration: 2.414812066s FAIL (2025-08-10 01:58:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.414855222s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 857.312484ms FAIL (2025-08-10 01:57:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 857.342905ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...........................X............................] duration: 2.917075541s FAIL (2025-08-10 01:57:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.917106837s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...X...........................X...........................] duration: 2.693639275s FAIL (2025-08-10 01:57:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.693669671s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 931.464705ms FAIL (2025-08-10 01:56:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 931.505351ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...X...........................X..........................] duration: 2.597178151s FAIL (2025-08-10 01:56:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.597204492s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...X...........................X.........................] duration: 2.418313996s FAIL (2025-08-10 01:55:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.418361742s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 855.615845ms FAIL (2025-08-10 01:55:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.653185ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...X...........................X........................] duration: 2.458086122s FAIL (2025-08-10 01:55:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.458118179s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...X...........................X.......................] duration: 2.547315743s FAIL (2025-08-10 01:54:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.547472941s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 903.675496ms FAIL (2025-08-10 01:54:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 903.70483ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...X...........................X......................] duration: 2.383276331s FAIL (2025-08-10 01:54:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.383308925s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.092880158s FAIL (2025-08-10 01:54:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.092922447s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...X...........................X.....................] duration: 2.398187188s FAIL (2025-08-10 01:53:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.398257334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 872.509674ms FAIL (2025-08-10 01:53:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 872.553714ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...X...........................X....................] duration: 2.420495305s FAIL (2025-08-10 01:52:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 10 01:37:04.316472028 (32h11m26.275569275s) [upload=33530]: Starting upload Aug 10 01:37:04.316558504 (32h11m26.275655757s) [upload=33530]: Done starting upload Aug 10 01:37:04.316644362 (32h11m26.275741622s) [upload=33530]: Uploading segments... Aug 10 01:37:04.317009819 (32h11m26.276107067s) [upload=33530]: Got next segment. Inline: false Aug 10 01:37:04.317100158 (32h11m26.276197392s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:37:04.317111748 (32h11m26.276208985s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 10 01:37:04.517416115 (32h11m26.476513367s) [seg_pos={0 0}, upload=33530]: Begin upload segment... Aug 10 01:37:04.517525113 (32h11m26.476622369s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518263442 (32h11m26.4773607s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.518887187 (32h11m26.477984438s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.519556180 (32h11m26.478653432s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.521448977 (32h11m26.480546257s) [seg_pos={0 0}, upload=33530]: Done begin upload segment. Aug 10 01:37:04.521523521 (32h11m26.480620781s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522113893 (32h11m26.481211151s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.522591894 (32h11m26.481689145s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523016365 (32h11m26.482113621s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.523597880 (32h11m26.482695135s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524078438 (32h11m26.483175689s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524476267 (32h11m26.48357352s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.524887827 (32h11m26.483985075s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525323581 (32h11m26.484420834s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.525773576 (32h11m26.484870826s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.528836046 (32h11m26.487933304s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.529578348 (32h11m26.488675606s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530314975 (32h11m26.48941223s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:04.530956641 (32h11m26.4900539s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Uploading piece... Aug 10 01:37:05.094607192 (32h11m27.053704432s) [upload=33530]: Next returned nil segment Aug 10 01:37:05.094624641 (32h11m27.053721888s) [upload=33530]: Waiting for error group managing segments... Aug 10 01:37:05.232330776 (32h11m27.191428029s) [noise=true , address=45.91.116.7:4012 , piece_id=5S4N22G6H5K7RIWTTAAM72FP3XQFL3ZGZOZPN6EOHFKCQWVASF5Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.269451682 (32h11m27.228548928s) [noise=true , address=104.36.82.36:4627 , piece_id=O2DTXZC3HFQ3EZYACAI5X2TWWSSRCJIWS5DVV2DXB4WC6DLXE7BA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.273461589 (32h11m27.23255882s) [noise=true , address=104.36.82.38:4717 , piece_id=5MUKGKGX2H2WDR6YLEGEC3HUP4ZXMMTDCYQI4FPGHN3YC3XZOJDA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.275622429 (32h11m27.234719675s) [noise=true , address=104.36.82.62:4417 , piece_id=UEOLZZUH2KIL4N23W2KN567ICDL63C2Y26C42RKED5JUTEZMXQNQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.276743247 (32h11m27.235840491s) [noise=true , address=104.36.82.20:4472 , piece_id=FKGDTCJEKYWBWU3URBKZXPC2XOGPZVZG2M2F5N3VKDCIJ2GNME3A, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.278075803 (32h11m27.237173035s) [noise=true , address=104.36.82.4:4822 , piece_id=K7WYB7SOE3V5CS4DICY2XKG74X7NYMLLPK2KNTQZR34M2HCABAPA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279812484 (32h11m27.238909724s) [noise=true , address=104.36.82.19:4424 , piece_id=LY7TYFUBS3KTVPFSDS7KGGAABKGRJC2LO45TG343FO4DC7IWMOFQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.279949775 (32h11m27.23904702s) [noise=true , address=104.36.82.47:4523 , piece_id=EFN6XMHHQBYTJSQTKGJP3TIQ4PSOJMIFQTQAGJ6NYH24UM3R24CQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294335921 (32h11m27.253433167s) [noise=true , address=104.36.82.8:4987 , piece_id=5LHFLGPTKAF6P7BGEF23YALD6V2PWCXCP6WFWAW3KHPI6BKLX4YQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.294963005 (32h11m27.254060246s) [noise=true , address=104.36.82.5:4846 , piece_id=VAMHTJAF3OZTFZL3DKFBHES2RJUY7MSNNC43OZ4LFZDFNEZ4GKWQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.299757644 (32h11m27.258854879s) [noise=true , address=104.36.82.59:4312 , piece_id=TNQPYOYESSQQVXESWIIZDKYEAQ76TBKRJJCVN2QENHOF7MQPRT3Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.316435245 (32h11m27.27553248s) [noise=true , address=104.36.82.61:4393 , piece_id=OO644CLIX75GX7BYTJQPI5DHSC6QCZWOSJ2WH44T4RNMO7JZP2EQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.488389522 (32h11m27.447486764s) [noise=true , address=104.36.82.60:4347 , piece_id=GAPBANAQH4RZIUDYOFD6UN52WJ4CXC64CLIZIRHDOOUOKVDY32VQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502830427 (32h11m27.461927659s) [noise=true , address=79.127.201.214:4301 , piece_id=BQIYF36VY3EEALKOBPURES2IKNIBSOZHQOUADL4Y5Z3UWYHGMSAA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: <nil> Aug 10 01:37:05.502857936 (32h11m27.461955182s) [seg_pos={0 0}, upload=33530]: Segment reached optimal threshold of 14 pieces. Aug 10 01:37:05.503145913 (32h11m27.462243149s) [noise=true , address=64.49.13.26:4949 , piece_id=GK6N2HAUZVHJNWJRW7T3NFMF52AYGQENXH67HMMM3YPSEC56TJZA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): internal: context canceled Aug 10 01:37:05.503300993 (32h11m27.462398246s) [noise=true , address=104.36.82.53:4136 , piece_id=B4WQ52YQNLUTKKTVPD5ZT7ANPDEX7UVIO2P6G7QRK3G5X5Y4GUZQ, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT): protocol: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32808->104.36.82.53:4136: use of closed network connection Aug 10 01:37:05.503519785 (32h11m27.46261702s) [noise=true , address=104.36.82.44:4887 , piece_id=MHOMXEVNMZMNPOLPEMLDZKPHQFBSWWZTYZJC57NTGIBCE2MNPA7Q, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF Aug 10 01:37:05.503600679 (32h11m27.462697924s) [noise=true , address=104.36.82.56:4262 , piece_id=ADDII7U7P47IKTBAL5DSPLJWXDD4BSBEMNHJHECAHQVOVCCP2ZIA, seg_pos={0 0}, upload=33530]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DY2kpdCo8EDSs1LHL6qBFo6qjnsb7FL1QDekMV5qaWB5jxeMz): protocol: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51780->104.36.82.56:4262: use of closed network connection Aug 10 01:37:05.503616356 (32h11m27.462713601s) [seg_pos={0 0}, upload=33530]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 10 01:37:05.503707191 (32h11m27.462804436s) [upload=33530]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 10 01:37:05.503712383 (32h11m27.462809628s) [upload=33530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:37:05.674704080 (32h11m27.633801316s) [upload=33530]: Done uploading segments... Aug 10 01:37:05.674736223 (32h11m27.633833468s) [upload=33530]: Upload finished. err: <nil> Duration: 2.420530105s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.008920467s FAIL (2025-08-10 01:52:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 01:30:10.259821841 (32h4m32.218919076s) [upload=33413]: Starting upload Aug 10 01:30:10.259883592 (32h4m32.218980841s) [upload=33413]: Done starting upload Aug 10 01:30:10.259995200 (32h4m32.219092449s) [upload=33413]: Uploading segments... Aug 10 01:30:10.260057091 (32h4m32.219154345s) [upload=33413]: Got next segment. Inline: true Aug 10 01:30:10.260063184 (32h4m32.219160429s) [upload=33413]: Waiting for error group managing segments... Aug 10 01:30:10.260107728 (32h4m32.219204973s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 10 01:30:10.260112419 (32h4m32.219209663s) [upload=33413]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 10 01:30:10.260114979 (32h4m32.219212224s) [upload=33413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 10 01:30:10.362330300 (32h4m32.321427546s) [upload=33413]: Done uploading segments... Aug 10 01:30:10.362350148 (32h4m32.321447394s) [upload=33413]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.00895191s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)