Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X............X......X.X.....] duration:
3.343510209s
FAIL (2025-08-15 21:31:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 3.343544221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.007559432s
FAIL (2025-08-15 21:30:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.007612296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X............X......X.X....] duration:
3.04858778s
FAIL (2025-08-15 21:30:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 3.04862865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.047046979s
FAIL (2025-08-15 21:30:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.047090511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X............X......X.X...] duration:
3.30197119s
FAIL (2025-08-15 21:29:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 3.301996327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.855362353s
FAIL (2025-08-15 21:29:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855390726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.17050375s
FAIL (2025-08-15 21:28:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.170551336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..................................X............X......X.X..] duration:
3.023749762s
FAIL (2025-08-15 21:28:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 3.023784453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.050377131s
FAIL (2025-08-15 21:27:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.050467323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X..................................X............X......X.X.] duration:
3.205080064s
FAIL (2025-08-15 21:27:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 3.205122611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X..................................X............X......X.X] duration:
4.430308565s
FAIL (2025-08-15 21:26:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 24f53aa6d3d9d6c12e65cc121b8b3f2621194897e63303e308a45353a7a6b0d8 != before 189e2e1630b0394c0c4d6f31351d75e9480d0b454f7b1b76506d2ac1b12c8c66
======LOGS======
Aug 15 21:26:23.723001205 (172h0m45.682098458s) [upload=179081]: Starting upload
Aug 15 21:26:23.723089852 (172h0m45.682187099s) [upload=179081]: Done starting upload
Aug 15 21:26:23.723263963 (172h0m45.682361212s) [upload=179081]: Uploading segments...
Aug 15 21:26:23.723670351 (172h0m45.682767599s) [upload=179081]: Got next segment. Inline: false
Aug 15 21:26:23.723750908 (172h0m45.682848164s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:26:23.723757880 (172h0m45.682855129s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:26:24.000741151 (172h0m45.959838421s) [seg_pos={0 0}, upload=179081]: Begin upload segment...
Aug 15 21:26:24.000829094 (172h0m45.959926347s) [seg_pos={0 0}, upload=179081]: Done begin upload segment.
Aug 15 21:26:24.000887939 (172h0m45.959985193s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001223721 (172h0m45.960320971s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.001730111 (172h0m45.960827359s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.002230879 (172h0m45.961328127s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003110135 (172h0m45.962207385s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.003174834 (172h0m45.962272084s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004073823 (172h0m45.963171073s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004121540 (172h0m45.963218791s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.004879430 (172h0m45.963976687s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005101640 (172h0m45.964198891s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.005421372 (172h0m45.964518619s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006098838 (172h0m45.965196095s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006527228 (172h0m45.965624485s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.006917523 (172h0m45.966014762s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007174592 (172h0m45.966271839s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007496936 (172h0m45.966594183s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.007775765 (172h0m45.966873014s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.010444798 (172h0m45.969542053s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Uploading piece...
Aug 15 21:26:24.580960028 (172h0m46.540057296s) [upload=179081]: Next returned nil segment
Aug 15 21:26:24.580985337 (172h0m46.540082594s) [upload=179081]: Waiting for error group managing segments...
Aug 15 21:26:24.756035543 (172h0m46.71513278s) [noise=true , address=104.36.82.18:4367 , piece_id=5XQ3IBNETGKTQRECGGDV2FDVPQOLVGVKW3VTHDPM4VSJG3QB4XVQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.786176299 (172h0m46.745273537s) [noise=true , address=104.36.82.38:4695 , piece_id=5LV6KTN37MGHERHHGEMXBWLD23QCPZVKFLZBGCODIOLFIBNQW4XQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.792414858 (172h0m46.751512097s) [noise=true , address=104.36.82.23:4455 , piece_id=WKWWFAWN7F7CQFKJJ4YK3CANXDIPBD7TY5TV7IPIKJGVNTDFMQRQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.831167108 (172h0m46.790264341s) [noise=true , address=104.36.82.45:4939 , piece_id=64HC6L4N6E2SN7KSIJPTHRKFCCHPFO5U25HSCXUBHN6TQ6UTVUKQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.883091760 (172h0m46.842188998s) [noise=true , address=104.36.82.44:4904 , piece_id=WO5SSTPLIQJIYCIR324VYKX6HAB6YVTCASLGDEOGINNM3IWTTTWQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.909181792 (172h0m46.86827906s) [noise=true , address=104.36.82.36:4620 , piece_id=N37DS52YJL5VTYJ6E3MF7RPY7WASNNZO43AKGJBRBUEG47BDDQ6Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.968490575 (172h0m46.927587822s) [noise=true , address=77.90.31.18:4819 , piece_id=FCBSLAUA4D5ZL6BAYESHHBB7NDHUVLA5YIAQEVETL5HY2CSXY4QQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.970323718 (172h0m46.929420954s) [noise=true , address=45.91.116.5:4318 , piece_id=SOU7FLIGUVGTAVSPIRCAVLZ7TKF3AQC7SPBZCXIQQVVQUN7GYOLA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:24.989331899 (172h0m46.948429155s) [noise=true , address=77.90.31.13:4660 , piece_id=KVEVM4766YIAVG6DURU2X3Q2SM62QWO5OXENNG6D7UQHR2K2G2NA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.019186816 (172h0m46.978284061s) [noise=true , address=104.36.82.59:4321 , piece_id=KIE6BCB26QTJKFXPGXGH5P7WCBFT63MZCIMNKKI7GJJWMRM4HQ2Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.081298051 (172h0m47.040395298s) [noise=true , address=104.36.82.39:4756 , piece_id=PZBOG3ODO5TDDSQ3JFQ6WX6LIMZDKNEIOWYLBU3NDFHPZK5MBSZQ, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.206954015 (172h0m47.16605125s) [noise=true , address=45.91.116.7:4019 , piece_id=Y2DI2H6JX5RD7CUDCPNH6EDUPUL4N3F2S5YYI5L76NJSFQSS76JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.238045831 (172h0m47.197143069s) [noise=true , address=104.36.82.2:4759 , piece_id=2YWDKV4WIAJCDN3QXXKFLK4TJYPA6SYEK3FKVAD4WHXKD5T2QP5Q, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308266722 (172h0m47.267363962s) [noise=true , address=45.91.116.8:4072 , piece_id=WNZ7HDHDPE5PNRWAN2JG73TMF5N64GSNWLJFSDQCQREL2BFLA74A, seg_pos={0 0}, upload=179081]: Done uploading piece. err: <nil>
Aug 15 21:26:25.308309194 (172h0m47.26740644s) [seg_pos={0 0}, upload=179081]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:26:25.308616443 (172h0m47.267713693s) [noise=true , address=64.49.13.155:4915 , piece_id=F4R6VNS53AJ7CIGFXRJOM77G7YSB5IX2AM6PZE42LQ4O4MKNG2JA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308703733 (172h0m47.267800977s) [noise=true , address=104.36.82.16:4313 , piece_id=6EN7RZRXAZIK4ARL5HFV5B3OOMMV352UW74POWCPG7GEWLLK7QSA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308744832 (172h0m47.267842078s) [noise=true , address=45.91.116.13:4167 , piece_id=MGLEYYX4MVTQVZYL3LACNDH7HGLTLTTZHNUQLMKVQHAKGH7KGEFA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49498->45.91.116.13:4167: use of closed network connection
Aug 15 21:26:25.308844255 (172h0m47.267941495s) [noise=true , address=77.90.31.19:4856 , piece_id=D3ITU3GP223PEB73MYGHREBPBIUBQXUY6BOIOVXFZ5J2ISKUPCIA, seg_pos={0 0}, upload=179081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3): protocol: expected piece hash; context canceled; EOF
Aug 15 21:26:25.308870481 (172h0m47.267967726s) [seg_pos={0 0}, upload=179081]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:26:25.308970708 (172h0m47.268067953s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:26:25.308975954 (172h0m47.268073199s) [upload=179081]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:26:26.523092930 (172h0m48.482190196s) [upload=179081]: Done uploading segments...
Aug 15 21:26:26.523117622 (172h0m48.482214871s) [upload=179081]: Upload finished. err: <nil>
Duration: 4.430345167s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.196656772s
FAIL (2025-08-15 21:26:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.196697347s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.435445158s
FAIL (2025-08-15 21:25:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.435477888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..................................X............X......X.] duration:
3.490758637s
FAIL (2025-08-15 21:25:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28562ec13d628309eab51c9764a6a77edb904712046dec58327cbc8cf2cef813 != before b1c227e0e75f30c96050460137ca6840602d0330818854f9e9f790eebd7d0951
======LOGS======
Aug 15 21:24:33.815824117 (171h58m55.774921377s) [upload=179047]: Starting upload
Aug 15 21:24:33.815906081 (171h58m55.775003329s) [upload=179047]: Done starting upload
Aug 15 21:24:33.816041563 (171h58m55.775138812s) [upload=179047]: Uploading segments...
Aug 15 21:24:33.816290205 (171h58m55.77538745s) [upload=179047]: Got next segment. Inline: false
Aug 15 21:24:33.816332578 (171h58m55.775429823s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:24:33.816340004 (171h58m55.775437249s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:24:34.053733945 (171h58m56.012831199s) [seg_pos={0 0}, upload=179047]: Begin upload segment...
Aug 15 21:24:34.053807707 (171h58m56.012904954s) [seg_pos={0 0}, upload=179047]: Done begin upload segment.
Aug 15 21:24:34.053844636 (171h58m56.012941882s) [noise=true , address=79.127.220.101:4068 , piece_id=ZP7ZW336TXRIFKOOUGNVDBUSQUU6TXA45ZM4PBXF6ZJP4HN4UTMA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.053862427 (171h58m56.012959685s) [noise=true , address=104.36.82.5:4845 , piece_id=MIARFRPHJJPEMKZUKPON3C55OZJUVEFIFNA4JQOR2LQ6TMJ77ENA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054461480 (171h58m56.013558734s) [noise=true , address=77.90.31.12:4595 , piece_id=WDRYTGPWQITH6MNVT6WEW7WQ7NN3YTZ4G45VBKGLWIM65EPEK4KQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054495858 (171h58m56.013593112s) [noise=true , address=104.36.82.35:4591 , piece_id=3UYTAX5Q2WGLG5XZNU4HXPYNB4R5EZXDCT2A2PD5KBQKBHMNY3XQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054884495 (171h58m56.013981755s) [noise=true , address=77.90.31.15:4729 , piece_id=ENPZCSNLFIDULLBXRISGIN44VKHBBY6B7RJW5A7SIX5EFRZFOB5Q, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055044330 (171h58m56.014141584s) [noise=true , address=64.49.13.27:4960 , piece_id=ZCTEJGAIW2ZHWIYBVR55DMNIHCKW6DY2EUVWEBLQHNTRAXDRNCJA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055291550 (171h58m56.014388802s) [noise=true , address=104.36.82.46:4483 , piece_id=G7OBE5JYZQKUEGZYULMNMPZIR5L7RLMZMDQOYK4YH6G6F2RTBKPA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055416148 (171h58m56.014513393s) [noise=true , address=104.36.82.22:4533 , piece_id=QWC56G5O2WQD3YRQJE4M4DGRCAGCAS4GCD7SKF2JAB7PEGJVTOAQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055673990 (171h58m56.014771246s) [noise=true , address=104.36.82.13:4193 , piece_id=XLWZES2DAFAFZHZDA3V6HJRFCTSGCLQIDHLG7LTXYORQAIMIKXXA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055743382 (171h58m56.01484064s) [noise=true , address=79.127.201.214:4322 , piece_id=7ZTKHTYCR3WMQT6O24ZV5LV7DDMGPTEVQQE5PMCGD7ZZIPAA32HQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056052717 (171h58m56.015150219s) [noise=true , address=45.91.116.10:4113 , piece_id=62ILF6J6HGU5QWDSUB5NY7PM5SHQOWPBCKC5Q7MMGPGTZZAZW7DQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056172849 (171h58m56.015270094s) [noise=true , address=104.36.82.4:4836 , piece_id=GTGRYQKDHG6SEUI6TORITJWJXDWAHFCOMKXG2XH73LVRLDIMBV4A, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056419334 (171h58m56.015516591s) [noise=true , address=77.90.31.18:4827 , piece_id=MYLS5KAGAURFDFPNJQUQQ6ZTNGKA6S4FJMYHYZNLGS7YHXMWFNCQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056504535 (171h58m56.015601783s) [noise=true , address=77.90.31.16:4750 , piece_id=WEWFXPKV5NOVQMJID7Y7IFNKRMLZMTZ6FHFCPMFKP5A3F3XLYPKA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056795226 (171h58m56.01589249s) [noise=true , address=104.36.82.44:4877 , piece_id=HMK4WWVE24PCG37S42AJDEKWYT2FIUYPALDGU3LZFBHHHABQJSMA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056949933 (171h58m56.016047178s) [noise=true , address=77.90.31.10:4523 , piece_id=GCE6S6YBKDGSP2WTYPCOEALWCJHPMEIN64JYQ2EBAIR5JGSIWMCA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.057195602 (171h58m56.01629286s) [noise=true , address=104.36.82.39:4744 , piece_id=WYIEDA3NVRPRDT5LL7DOFIS2ATJJAMHH5KT4U3PZJIPXR6GGDVZA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.057533050 (171h58m56.016630303s) [noise=true , address=104.36.82.47:4525 , piece_id=DMXPWRZRJC3KH6W5QEY3OCGP46MM4UZ27JDN3EDZVQ544J3LNEAQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.651092112 (171h58m56.610189363s) [upload=179047]: Next returned nil segment
Aug 15 21:24:34.651130541 (171h58m56.610227797s) [upload=179047]: Waiting for error group managing segments...
Aug 15 21:24:34.809352196 (171h58m56.768449439s) [noise=true , address=104.36.82.47:4525 , piece_id=DMXPWRZRJC3KH6W5QEY3OCGP46MM4UZ27JDN3EDZVQ544J3LNEAQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.859544976 (171h58m56.818642213s) [noise=true , address=104.36.82.39:4744 , piece_id=WYIEDA3NVRPRDT5LL7DOFIS2ATJJAMHH5KT4U3PZJIPXR6GGDVZA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.873380100 (171h58m56.83247734s) [noise=true , address=104.36.82.35:4591 , piece_id=3UYTAX5Q2WGLG5XZNU4HXPYNB4R5EZXDCT2A2PD5KBQKBHMNY3XQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.884249489 (171h58m56.843346735s) [noise=true , address=104.36.82.22:4533 , piece_id=QWC56G5O2WQD3YRQJE4M4DGRCAGCAS4GCD7SKF2JAB7PEGJVTOAQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.943676087 (171h58m56.902773334s) [noise=true , address=79.127.220.101:4068 , piece_id=ZP7ZW336TXRIFKOOUGNVDBUSQUU6TXA45ZM4PBXF6ZJP4HN4UTMA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.994232739 (171h58m56.953329978s) [noise=true , address=79.127.201.214:4322 , piece_id=7ZTKHTYCR3WMQT6O24ZV5LV7DDMGPTEVQQE5PMCGD7ZZIPAA32HQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.028738279 (171h58m56.98783551s) [noise=true , address=104.36.82.13:4193 , piece_id=XLWZES2DAFAFZHZDA3V6HJRFCTSGCLQIDHLG7LTXYORQAIMIKXXA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.035180641 (171h58m56.994277874s) [noise=true , address=104.36.82.4:4836 , piece_id=GTGRYQKDHG6SEUI6TORITJWJXDWAHFCOMKXG2XH73LVRLDIMBV4A, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.258195222 (171h58m57.217292454s) [noise=true , address=45.91.116.10:4113 , piece_id=62ILF6J6HGU5QWDSUB5NY7PM5SHQOWPBCKC5Q7MMGPGTZZAZW7DQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.273601204 (171h58m57.23269844s) [noise=true , address=77.90.31.18:4827 , piece_id=MYLS5KAGAURFDFPNJQUQQ6ZTNGKA6S4FJMYHYZNLGS7YHXMWFNCQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.323940485 (171h58m57.283037717s) [noise=true , address=64.49.13.27:4960 , piece_id=ZCTEJGAIW2ZHWIYBVR55DMNIHCKW6DY2EUVWEBLQHNTRAXDRNCJA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.353569736 (171h58m57.312666974s) [noise=true , address=77.90.31.15:4729 , piece_id=ENPZCSNLFIDULLBXRISGIN44VKHBBY6B7RJW5A7SIX5EFRZFOB5Q, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.426229243 (171h58m57.385326481s) [noise=true , address=77.90.31.16:4750 , piece_id=WEWFXPKV5NOVQMJID7Y7IFNKRMLZMTZ6FHFCPMFKP5A3F3XLYPKA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.683298888 (171h58m57.642396125s) [noise=true , address=77.90.31.10:4523 , piece_id=GCE6S6YBKDGSP2WTYPCOEALWCJHPMEIN64JYQ2EBAIR5JGSIWMCA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.683347586 (171h58m57.642444835s) [seg_pos={0 0}, upload=179047]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:24:35.683555941 (171h58m57.642653175s) [noise=true , address=104.36.82.44:4877 , piece_id=HMK4WWVE24PCG37S42AJDEKWYT2FIUYPALDGU3LZFBHHHABQJSMA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683696379 (171h58m57.642793614s) [noise=true , address=77.90.31.12:4595 , piece_id=WDRYTGPWQITH6MNVT6WEW7WQ7NN3YTZ4G45VBKGLWIM65EPEK4KQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683781006 (171h58m57.642878243s) [noise=true , address=104.36.82.46:4483 , piece_id=G7OBE5JYZQKUEGZYULMNMPZIR5L7RLMZMDQOYK4YH6G6F2RTBKPA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683856683 (171h58m57.642953922s) [noise=true , address=104.36.82.5:4845 , piece_id=MIARFRPHJJPEMKZUKPON3C55OZJUVEFIFNA4JQOR2LQ6TMJ77ENA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683883583 (171h58m57.642980836s) [seg_pos={0 0}, upload=179047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:24:35.683975552 (171h58m57.643072796s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:24:35.683981488 (171h58m57.643078733s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:24:36.007717296 (171h58m57.966814531s) [upload=179047]: Done uploading segments...
Aug 15 21:24:36.007749009 (171h58m57.966846245s) [upload=179047]: Upload finished. err: <nil>
Duration: 3.491189705s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..................................X............X......X] duration:
3.566302552s
FAIL (2025-08-15 21:24:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28562ec13d628309eab51c9764a6a77edb904712046dec58327cbc8cf2cef813 != before b1c227e0e75f30c96050460137ca6840602d0330818854f9e9f790eebd7d0951
======LOGS======
Aug 15 21:24:33.815824117 (171h58m55.774921377s) [upload=179047]: Starting upload
Aug 15 21:24:33.815906081 (171h58m55.775003329s) [upload=179047]: Done starting upload
Aug 15 21:24:33.816041563 (171h58m55.775138812s) [upload=179047]: Uploading segments...
Aug 15 21:24:33.816290205 (171h58m55.77538745s) [upload=179047]: Got next segment. Inline: false
Aug 15 21:24:33.816332578 (171h58m55.775429823s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:24:33.816340004 (171h58m55.775437249s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:24:34.053733945 (171h58m56.012831199s) [seg_pos={0 0}, upload=179047]: Begin upload segment...
Aug 15 21:24:34.053807707 (171h58m56.012904954s) [seg_pos={0 0}, upload=179047]: Done begin upload segment.
Aug 15 21:24:34.053844636 (171h58m56.012941882s) [noise=true , address=79.127.220.101:4068 , piece_id=ZP7ZW336TXRIFKOOUGNVDBUSQUU6TXA45ZM4PBXF6ZJP4HN4UTMA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.053862427 (171h58m56.012959685s) [noise=true , address=104.36.82.5:4845 , piece_id=MIARFRPHJJPEMKZUKPON3C55OZJUVEFIFNA4JQOR2LQ6TMJ77ENA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054461480 (171h58m56.013558734s) [noise=true , address=77.90.31.12:4595 , piece_id=WDRYTGPWQITH6MNVT6WEW7WQ7NN3YTZ4G45VBKGLWIM65EPEK4KQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054495858 (171h58m56.013593112s) [noise=true , address=104.36.82.35:4591 , piece_id=3UYTAX5Q2WGLG5XZNU4HXPYNB4R5EZXDCT2A2PD5KBQKBHMNY3XQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.054884495 (171h58m56.013981755s) [noise=true , address=77.90.31.15:4729 , piece_id=ENPZCSNLFIDULLBXRISGIN44VKHBBY6B7RJW5A7SIX5EFRZFOB5Q, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055044330 (171h58m56.014141584s) [noise=true , address=64.49.13.27:4960 , piece_id=ZCTEJGAIW2ZHWIYBVR55DMNIHCKW6DY2EUVWEBLQHNTRAXDRNCJA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055291550 (171h58m56.014388802s) [noise=true , address=104.36.82.46:4483 , piece_id=G7OBE5JYZQKUEGZYULMNMPZIR5L7RLMZMDQOYK4YH6G6F2RTBKPA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055416148 (171h58m56.014513393s) [noise=true , address=104.36.82.22:4533 , piece_id=QWC56G5O2WQD3YRQJE4M4DGRCAGCAS4GCD7SKF2JAB7PEGJVTOAQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055673990 (171h58m56.014771246s) [noise=true , address=104.36.82.13:4193 , piece_id=XLWZES2DAFAFZHZDA3V6HJRFCTSGCLQIDHLG7LTXYORQAIMIKXXA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.055743382 (171h58m56.01484064s) [noise=true , address=79.127.201.214:4322 , piece_id=7ZTKHTYCR3WMQT6O24ZV5LV7DDMGPTEVQQE5PMCGD7ZZIPAA32HQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056052717 (171h58m56.015150219s) [noise=true , address=45.91.116.10:4113 , piece_id=62ILF6J6HGU5QWDSUB5NY7PM5SHQOWPBCKC5Q7MMGPGTZZAZW7DQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056172849 (171h58m56.015270094s) [noise=true , address=104.36.82.4:4836 , piece_id=GTGRYQKDHG6SEUI6TORITJWJXDWAHFCOMKXG2XH73LVRLDIMBV4A, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056419334 (171h58m56.015516591s) [noise=true , address=77.90.31.18:4827 , piece_id=MYLS5KAGAURFDFPNJQUQQ6ZTNGKA6S4FJMYHYZNLGS7YHXMWFNCQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056504535 (171h58m56.015601783s) [noise=true , address=77.90.31.16:4750 , piece_id=WEWFXPKV5NOVQMJID7Y7IFNKRMLZMTZ6FHFCPMFKP5A3F3XLYPKA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056795226 (171h58m56.01589249s) [noise=true , address=104.36.82.44:4877 , piece_id=HMK4WWVE24PCG37S42AJDEKWYT2FIUYPALDGU3LZFBHHHABQJSMA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.056949933 (171h58m56.016047178s) [noise=true , address=77.90.31.10:4523 , piece_id=GCE6S6YBKDGSP2WTYPCOEALWCJHPMEIN64JYQ2EBAIR5JGSIWMCA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.057195602 (171h58m56.01629286s) [noise=true , address=104.36.82.39:4744 , piece_id=WYIEDA3NVRPRDT5LL7DOFIS2ATJJAMHH5KT4U3PZJIPXR6GGDVZA, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.057533050 (171h58m56.016630303s) [noise=true , address=104.36.82.47:4525 , piece_id=DMXPWRZRJC3KH6W5QEY3OCGP46MM4UZ27JDN3EDZVQ544J3LNEAQ, seg_pos={0 0}, upload=179047]: Uploading piece...
Aug 15 21:24:34.651092112 (171h58m56.610189363s) [upload=179047]: Next returned nil segment
Aug 15 21:24:34.651130541 (171h58m56.610227797s) [upload=179047]: Waiting for error group managing segments...
Aug 15 21:24:34.809352196 (171h58m56.768449439s) [noise=true , address=104.36.82.47:4525 , piece_id=DMXPWRZRJC3KH6W5QEY3OCGP46MM4UZ27JDN3EDZVQ544J3LNEAQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.859544976 (171h58m56.818642213s) [noise=true , address=104.36.82.39:4744 , piece_id=WYIEDA3NVRPRDT5LL7DOFIS2ATJJAMHH5KT4U3PZJIPXR6GGDVZA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.873380100 (171h58m56.83247734s) [noise=true , address=104.36.82.35:4591 , piece_id=3UYTAX5Q2WGLG5XZNU4HXPYNB4R5EZXDCT2A2PD5KBQKBHMNY3XQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.884249489 (171h58m56.843346735s) [noise=true , address=104.36.82.22:4533 , piece_id=QWC56G5O2WQD3YRQJE4M4DGRCAGCAS4GCD7SKF2JAB7PEGJVTOAQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.943676087 (171h58m56.902773334s) [noise=true , address=79.127.220.101:4068 , piece_id=ZP7ZW336TXRIFKOOUGNVDBUSQUU6TXA45ZM4PBXF6ZJP4HN4UTMA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:34.994232739 (171h58m56.953329978s) [noise=true , address=79.127.201.214:4322 , piece_id=7ZTKHTYCR3WMQT6O24ZV5LV7DDMGPTEVQQE5PMCGD7ZZIPAA32HQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.028738279 (171h58m56.98783551s) [noise=true , address=104.36.82.13:4193 , piece_id=XLWZES2DAFAFZHZDA3V6HJRFCTSGCLQIDHLG7LTXYORQAIMIKXXA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.035180641 (171h58m56.994277874s) [noise=true , address=104.36.82.4:4836 , piece_id=GTGRYQKDHG6SEUI6TORITJWJXDWAHFCOMKXG2XH73LVRLDIMBV4A, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.258195222 (171h58m57.217292454s) [noise=true , address=45.91.116.10:4113 , piece_id=62ILF6J6HGU5QWDSUB5NY7PM5SHQOWPBCKC5Q7MMGPGTZZAZW7DQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.273601204 (171h58m57.23269844s) [noise=true , address=77.90.31.18:4827 , piece_id=MYLS5KAGAURFDFPNJQUQQ6ZTNGKA6S4FJMYHYZNLGS7YHXMWFNCQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.323940485 (171h58m57.283037717s) [noise=true , address=64.49.13.27:4960 , piece_id=ZCTEJGAIW2ZHWIYBVR55DMNIHCKW6DY2EUVWEBLQHNTRAXDRNCJA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.353569736 (171h58m57.312666974s) [noise=true , address=77.90.31.15:4729 , piece_id=ENPZCSNLFIDULLBXRISGIN44VKHBBY6B7RJW5A7SIX5EFRZFOB5Q, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.426229243 (171h58m57.385326481s) [noise=true , address=77.90.31.16:4750 , piece_id=WEWFXPKV5NOVQMJID7Y7IFNKRMLZMTZ6FHFCPMFKP5A3F3XLYPKA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.683298888 (171h58m57.642396125s) [noise=true , address=77.90.31.10:4523 , piece_id=GCE6S6YBKDGSP2WTYPCOEALWCJHPMEIN64JYQ2EBAIR5JGSIWMCA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: <nil>
Aug 15 21:24:35.683347586 (171h58m57.642444835s) [seg_pos={0 0}, upload=179047]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:24:35.683555941 (171h58m57.642653175s) [noise=true , address=104.36.82.44:4877 , piece_id=HMK4WWVE24PCG37S42AJDEKWYT2FIUYPALDGU3LZFBHHHABQJSMA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683696379 (171h58m57.642793614s) [noise=true , address=77.90.31.12:4595 , piece_id=WDRYTGPWQITH6MNVT6WEW7WQ7NN3YTZ4G45VBKGLWIM65EPEK4KQ, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683781006 (171h58m57.642878243s) [noise=true , address=104.36.82.46:4483 , piece_id=G7OBE5JYZQKUEGZYULMNMPZIR5L7RLMZMDQOYK4YH6G6F2RTBKPA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683856683 (171h58m57.642953922s) [noise=true , address=104.36.82.5:4845 , piece_id=MIARFRPHJJPEMKZUKPON3C55OZJUVEFIFNA4JQOR2LQ6TMJ77ENA, seg_pos={0 0}, upload=179047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nChJBXktwFs6z7cSK2Wh6N3jkAZwTZ7zhEUt393Nnx4eB6ube): protocol: expected piece hash; context canceled; EOF
Aug 15 21:24:35.683883583 (171h58m57.642980836s) [seg_pos={0 0}, upload=179047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:24:35.683975552 (171h58m57.643072796s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:24:35.683981488 (171h58m57.643078733s) [upload=179047]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:24:36.007717296 (171h58m57.966814531s) [upload=179047]: Done uploading segments...
Aug 15 21:24:36.007749009 (171h58m57.966846245s) [upload=179047]: Upload finished. err: <nil>
Duration: 3.566338424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.67134841s
FAIL (2025-08-15 21:24:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.671374535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..................................X............X......] duration:
3.796577982s
FAIL (2025-08-15 21:23:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 3.79661819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
963.091488ms
FAIL (2025-08-15 21:23:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.122641ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..................................X............X.....] duration:
3.986525363s
FAIL (2025-08-15 21:23:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 3.986558408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.268088306s
FAIL (2025-08-15 21:23:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.268139944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.106964461s
FAIL (2025-08-15 21:22:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.107001562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..................................X............X....] duration:
3.475263817s
FAIL (2025-08-15 21:22:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 3.475359999s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.05508851s
FAIL (2025-08-15 21:21:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.05511498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..................................X............X...] duration:
2.88288381s
FAIL (2025-08-15 21:21:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 2.882926093s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.197493243s
FAIL (2025-08-15 21:21:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.197580261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..................................X............X..] duration:
4.50511867s
FAIL (2025-08-15 21:20:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 4.505157921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
911.639889ms
FAIL (2025-08-15 21:20:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 911.660443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..................................X............X.] duration:
4.468244568s
FAIL (2025-08-15 21:20:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 4.46830025s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.365954502s
FAIL (2025-08-15 21:19:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.36598915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..................................X............X] duration:
3.892289189s
FAIL (2025-08-15 21:19:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1621a98603731704fac2978388f38de878b7f8a30271e6c70fcf2ab13229084a != before c8e328c57962a43323ba80300dbda867cac8582e95c9177e2d7791b8a72a6f49
======LOGS======
Aug 15 21:19:11.129320502 (171h53m33.088417738s) [upload=178956]: Starting upload
Aug 15 21:19:11.129357437 (171h53m33.08845474s) [upload=178956]: Done starting upload
Aug 15 21:19:11.129619663 (171h53m33.088716898s) [upload=178956]: Uploading segments...
Aug 15 21:19:11.129661173 (171h53m33.088758472s) [upload=178956]: Got next segment. Inline: false
Aug 15 21:19:11.129691778 (171h53m33.088789025s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:19:11.129697284 (171h53m33.088794531s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:19:11.385579884 (171h53m33.344677123s) [seg_pos={0 0}, upload=178956]: Begin upload segment...
Aug 15 21:19:11.385634875 (171h53m33.344732113s) [seg_pos={0 0}, upload=178956]: Done begin upload segment.
Aug 15 21:19:11.385665202 (171h53m33.344762436s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386285637 (171h53m33.34538289s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386617384 (171h53m33.345714632s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.386900956 (171h53m33.345998204s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.387966967 (171h53m33.347064299s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.388571638 (171h53m33.347668891s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.389287622 (171h53m33.34838488s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.391963052 (171h53m33.351060367s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.392712923 (171h53m33.351810186s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.394237300 (171h53m33.353334554s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406260968 (171h53m33.365358225s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.406842136 (171h53m33.365939389s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407219575 (171h53m33.366316811s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407605411 (171h53m33.366702689s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.407982010 (171h53m33.367079271s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408414977 (171h53m33.367512235s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.408814154 (171h53m33.367911391s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.409176772 (171h53m33.368274027s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Uploading piece...
Aug 15 21:19:11.979660930 (171h53m33.938758166s) [upload=178956]: Next returned nil segment
Aug 15 21:19:11.979685017 (171h53m33.938782284s) [upload=178956]: Waiting for error group managing segments...
Aug 15 21:19:12.148340218 (171h53m34.107437469s) [noise=true , address=77.90.31.13:4632 , piece_id=J4622EEJ65OO22PXH7XKVBQYGN36GUL75G6647CPPBYWWTX6R3TQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.152001612 (171h53m34.111098847s) [noise=true , address=45.91.116.4:4954 , piece_id=DPJYRM7TDFQACMTMYJOGLTGKEACRZI2YTQAEP5IEOWZGO5LYU2UA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.190477641 (171h53m34.149574894s) [noise=true , address=77.90.31.15:4718 , piece_id=5332T2GYGGRD6L4FUXUXHAG27E2MSAUGQG2KGNK5J3GBV6GNGJTA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.200592471 (171h53m34.159689727s) [noise=true , address=77.90.31.21:4893 , piece_id=25TREZN6W5HRCNAQ64H2SY4C4LTMITMPK65OGBTAXFE5IZDFFX4A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.202561963 (171h53m34.161659204s) [noise=true , address=77.90.31.18:4822 , piece_id=HBMXYPNDWFWHLHZTQCLQK6M4VWFWDRBNP6WMW2UDGOHU66DTXJIQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.255689372 (171h53m34.214786605s) [noise=true , address=104.36.82.44:4870 , piece_id=IN4XI2BES4AFMBS6BNOMSETKP4YMJMQR6NMJHQJL7DLGLMWVW43Q, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.269637802 (171h53m34.228735041s) [noise=true , address=104.36.82.47:4552 , piece_id=5HIKE6YEM52RNS4SUS5ZE5VNLX5U2T4BYKB65J2DFTFBDPI2JCNA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.361352630 (171h53m34.320449867s) [noise=true , address=104.36.82.38:4695 , piece_id=XFVVZKJ4YPBGJWALEXZWLIOGF55AL3G6XIM4GAPKXKD5EXNUNGJA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.396232973 (171h53m34.355330208s) [noise=true , address=104.36.82.18:4398 , piece_id=YVKAPINDJNWJV3BP6PXRHJ544NUFAMZH45WUYZX7COFJ2E4J5YLQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.432009444 (171h53m34.391106699s) [noise=true , address=104.36.82.38:4691 , piece_id=LYBC26AREHT75GUSRSQTY76RJFJDYZFIEH2YR5SJ3AJVNDIPHLBQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.496829050 (171h53m34.455926299s) [noise=true , address=79.127.201.215:4357 , piece_id=THHKUIJREHEILEW444IX5B7N24ZUG7AZEFDFQCM5G3ASBITPCTDQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.623718332 (171h53m34.582815587s) [noise=true , address=104.36.82.56:4254 , piece_id=TYVAJ5X6VJTHOSE2JK3EFFA2Z6WE2X4XNKN2AS7FWUCDGMQH3CEA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:12.668181558 (171h53m34.627278812s) [noise=true , address=104.36.82.62:4421 , piece_id=EJ536GC5EIQQOBJGLSD55KQPCWSMDGHHD4E7WJXTPLRP4JGY5O3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210056156 (171h53m35.169153418s) [noise=true , address=104.36.82.7:4926 , piece_id=YINIIRCGPLWBEYULLLN45DXUSOMUW6GHMCQ4TP44L27UTI4T7U3A, seg_pos={0 0}, upload=178956]: Done uploading piece. err: <nil>
Aug 15 21:19:13.210097996 (171h53m35.169195244s) [seg_pos={0 0}, upload=178956]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:19:13.210382751 (171h53m35.169480001s) [noise=true , address=104.36.82.51:4080 , piece_id=OM3RT7JSMUTFDXOQMNTIJBWXV6K7JSQIUVKAGH2UH7O4R6CLYYSA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WXMdaUQnFnXfayz6CkmsK1wuLhWSpXjQQt2kZyVTVnv3qL44C): protocol: expected piece hash; context canceled; EOF
Aug 15 21:19:13.210713553 (171h53m35.169810803s) [noise=true , address=104.36.82.5:4872 , piece_id=KTT6I5OBO4QVYIE2ZALGUPITAQDC6W2ZXERPRXJPBZHODCEPGXEQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45116->104.36.82.5:4872: use of closed network connection
Aug 15 21:19:13.210810901 (171h53m35.169908151s) [noise=true , address=104.36.82.23:4447 , piece_id=PHHGLUDKXNU4G7DJIXQIKUPNFNNTS22P4HHVCSLEEWGEGTJHXYYQ, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51058->104.36.82.23:4447: use of closed network connection
Aug 15 21:19:13.210978000 (171h53m35.170075248s) [noise=true , address=104.36.82.36:4642 , piece_id=5BIOU46K4QLGME2JHAY4JD4VZ2GFQC6KBZIHNZH3GYNH2TTJIFRA, seg_pos={0 0}, upload=178956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection; write tcp 139.59.144.22:34542->104.36.82.36:4642: use of closed network connection
Aug 15 21:19:13.210997608 (171h53m35.170094868s) [seg_pos={0 0}, upload=178956]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:19:13.211087874 (171h53m35.170185133s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:19:13.211093835 (171h53m35.170191093s) [upload=178956]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:19:13.489236659 (171h53m35.448333915s) [upload=178956]: Done uploading segments...
Aug 15 21:19:13.489277961 (171h53m35.448375217s) [upload=178956]: Upload finished. err: <nil>
Duration: 3.892323045s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..................................X............] duration:
3.602096488s
FAIL (2025-08-15 21:18:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.602131165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
926.80835ms
FAIL (2025-08-15 21:18:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 926.847119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................................X...........] duration:
2.799847574s
FAIL (2025-08-15 21:18:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 2.799883879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..................................X..........] duration:
3.093167716s
FAIL (2025-08-15 21:17:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.093209003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
993.578478ms
FAIL (2025-08-15 21:17:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 993.615746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..................................X.........] duration:
5.183525535s
FAIL (2025-08-15 21:16:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 5.183561873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
883.23391ms
FAIL (2025-08-15 21:16:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.290807ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..................................X........] duration:
3.685223729s
FAIL (2025-08-15 21:15:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.685273046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..................................X.......] duration:
2.783882915s
FAIL (2025-08-15 21:15:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 2.783923472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
950.999038ms
FAIL (2025-08-15 21:15:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 951.089883ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..................................X......] duration:
3.091686473s
FAIL (2025-08-15 21:14:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.091717996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
877.027466ms
FAIL (2025-08-15 21:14:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.058378ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..................................X.....] duration:
3.021109609s
FAIL (2025-08-15 21:13:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.021150013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..................................X....] duration:
3.657222798s
FAIL (2025-08-15 21:13:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.657328794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
967.304257ms
FAIL (2025-08-15 21:13:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 967.3403ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.095130546s
FAIL (2025-08-15 21:13:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.09516914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.034657745s
FAIL (2025-08-15 21:12:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.034704021s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..................................X...] duration:
3.226070923s
FAIL (2025-08-15 21:12:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.226106832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..................................X..] duration:
3.181115912s
FAIL (2025-08-15 21:12:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f3436f3a7d03073d8ff162c1ca74f17d9a358bab566aa36427c4ea5c33e9c63 != before 6ee1d49970dbc406aea709fc491b2ac6204dbef7f13378513d3bd6954687ea4a
======LOGS======
Aug 15 21:10:30.404322304 (171h44m52.363419536s) [upload=178807]: Starting upload
Aug 15 21:10:30.404390869 (171h44m52.363488117s) [upload=178807]: Done starting upload
Aug 15 21:10:30.404485584 (171h44m52.363582821s) [upload=178807]: Uploading segments...
Aug 15 21:10:30.404775045 (171h44m52.36387229s) [upload=178807]: Got next segment. Inline: false
Aug 15 21:10:30.404816898 (171h44m52.363914143s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 21:10:30.404823849 (171h44m52.363921094s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 21:10:30.727297478 (171h44m52.686394732s) [seg_pos={0 0}, upload=178807]: Begin upload segment...
Aug 15 21:10:30.727363247 (171h44m52.686460485s) [seg_pos={0 0}, upload=178807]: Done begin upload segment.
Aug 15 21:10:30.727389957 (171h44m52.686487208s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727426785 (171h44m52.686524037s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.727870056 (171h44m52.686967311s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728214304 (171h44m52.687311556s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728333250 (171h44m52.687430501s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728518550 (171h44m52.687615796s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728711832 (171h44m52.68780908s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.728799332 (171h44m52.687896577s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729048159 (171h44m52.688145413s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729375488 (171h44m52.688472733s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.729712786 (171h44m52.688810037s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730199822 (171h44m52.689297067s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730557970 (171h44m52.689655226s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.730880711 (171h44m52.689977965s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731203791 (171h44m52.690301046s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731284827 (171h44m52.690382079s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731678969 (171h44m52.690776223s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:30.731900576 (171h44m52.690997824s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Uploading piece...
Aug 15 21:10:31.296164534 (171h44m53.255261773s) [upload=178807]: Next returned nil segment
Aug 15 21:10:31.296200014 (171h44m53.255297267s) [upload=178807]: Waiting for error group managing segments...
Aug 15 21:10:31.467837095 (171h44m53.426934335s) [noise=true , address=104.36.82.35:4614 , piece_id=BY4AJD6GC5YX6AOEIE2GVVJIVWRIT227O7IMDGLT636K6BRNQFNA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.475353904 (171h44m53.434451158s) [noise=true , address=104.36.82.18:4365 , piece_id=ZVUXUAXQMVKTBVHYQWTJ5RHBFBLWDRL4QYURKYBZFWSAPKUGWDXQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.517558856 (171h44m53.476656102s) [noise=true , address=104.36.82.17:4343 , piece_id=CM6GNCANIGPNHBXLDH2DHJF2TGK2L62SACAHKT3QMJPFCLYTFF6A, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.542304398 (171h44m53.501401631s) [noise=true , address=104.36.82.40:4975 , piece_id=UEAD73Y6XLI3V4BMDAAEKMAXOWGO6BBK2FC34RBV6S2K6Y323RAA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.550741798 (171h44m53.509839036s) [noise=true , address=104.36.82.4:4809 , piece_id=IYX6LSVKVUF4WPGF5TYZBSJMGAG5W7TSBBYJ37JJS3S6IWNAX7YQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.553296244 (171h44m53.512393504s) [noise=true , address=104.36.82.6:4899 , piece_id=QP2GEGF6SU6DZOAYPLBF2UUGLZ7TVT422Y45BHDJQVJ4M2TUDUKQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.568230506 (171h44m53.527327737s) [noise=true , address=104.36.82.2:4753 , piece_id=WL3E3S2P6ANC2OZUVZK4JNHSVUKNGMS27IZUHTUIPZPLCGF5KMIQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.589090351 (171h44m53.548187582s) [noise=true , address=77.90.31.15:4716 , piece_id=4XNNIEEZGNHILUDL2AB3L6GD7O6PRWNVAKTR6KNW5L2AHDGIV2CQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.605313252 (171h44m53.564410497s) [noise=true , address=104.36.82.58:4270 , piece_id=RTLOAPDDFFMV7OLIJK22WK4NAA3NLXUJ7E2HJBANXX4B4NDQKBVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.627997025 (171h44m53.587094271s) [noise=true , address=77.90.31.12:4598 , piece_id=HLE7FNABSQ3GVZBYWZ2CLFRSZSR3FCZR5ZGPJJAQJZJ7JEXYCNVQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.632698555 (171h44m53.591795794s) [noise=true , address=104.36.82.3:4773 , piece_id=BOVWDH2GVPD6GDX23N4RRAPRNDRH4DCINNFJMQMKHNAIAW343RPQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.637219760 (171h44m53.596316993s) [noise=true , address=79.127.220.101:4062 , piece_id=YVUOX657MVZRBJVTQA4YEE2VU5GNYV5HLJ3EVGTWYQHT5ONALA3Q, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.644123262 (171h44m53.603220499s) [noise=true , address=104.36.82.19:4409 , piece_id=VSEY7BM4H3HFECNEOQGA534PBRRPYSB3LEEQY722FC47IRJIKTWQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652362326 (171h44m53.611459571s) [noise=true , address=104.36.82.49:4003 , piece_id=YAFVT2KFUVB2JKLIVXQHUQHIJIXFKLZJMTXKRQPXFEUSS7LW3XQQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: <nil>
Aug 15 21:10:31.652392058 (171h44m53.611489303s) [seg_pos={0 0}, upload=178807]: Segment reached optimal threshold of 14 pieces.
Aug 15 21:10:31.652633013 (171h44m53.61173025s) [noise=true , address=104.36.82.61:4390 , piece_id=FINKHBBMQ6OPSWWPZUQ5OMB2RLXDNLKSD5FJACWXPYCPSTMEPLHQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ex3KjvY38tkSstUAgALSN9i4tBKj2D24BfA6jWi34ntvqmJNT): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652702052 (171h44m53.611799297s) [noise=true , address=45.91.116.9:4287 , piece_id=WLLWNYMVHRCJ5EP5UCLSELKIRHAYDFO4LXDWYILARWQ4EYFOTIMA, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 15 21:10:31.652878581 (171h44m53.61197582s) [noise=true , address=64.49.13.170:4724 , piece_id=MKSTISE7JU4G3MBDVJOP77JYSSQVZPK4FCRLY4R2NC57373EQGZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37216->64.49.13.170:4724: use of closed network connection
Aug 15 21:10:31.652909887 (171h44m53.612007125s) [noise=true , address=104.36.82.36:4650 , piece_id=A23DHATIPSD23RFDQ5A73NIMLIVKYENOFKZIBILYG7RJQHH6S6ZQ, seg_pos={0 0}, upload=178807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FM1g8LyQ9LJCNjKLxJtTQyDNudVcN4tv3NsxKRTV5gVChjCzp): protocol: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51444->104.36.82.36:4650: use of closed network connection
Aug 15 21:10:31.652928099 (171h44m53.612025336s) [seg_pos={0 0}, upload=178807]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 21:10:31.653050602 (171h44m53.612147848s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 21:10:31.653056918 (171h44m53.612154163s) [upload=178807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 21:10:31.999058824 (171h44m53.958156069s) [upload=178807]: Done uploading segments...
Aug 15 21:10:31.999079660 (171h44m53.9581769s) [upload=178807]: Upload finished. err: <nil>
Duration: 3.181158286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.060147294s
FAIL (2025-08-15 21:11:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 20:48:34.167086552 (171h22m56.126183798s) [upload=178435]: Starting upload Aug 15 20:48:34.167174027 (171h22m56.126271284s) [upload=178435]: Done starting upload Aug 15 20:48:34.167473303 (171h22m56.12657055s) [upload=178435]: Uploading segments... Aug 15 20:48:34.167572882 (171h22m56.126670139s) [upload=178435]: Got next segment. Inline: true Aug 15 20:48:34.167580257 (171h22m56.12667751s) [upload=178435]: Waiting for error group managing segments... Aug 15 20:48:34.167758542 (171h22m56.126855825s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 20:48:34.167916445 (171h22m56.127013705s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 20:48:34.167924871 (171h22m56.127022129s) [upload=178435]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 20:48:34.261939613 (171h22m56.221036869s) [upload=178435]: Done uploading segments... Aug 15 20:48:34.262001184 (171h22m56.22109844s) [upload=178435]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.060245979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|