Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration:
835.246263ms
FAIL (2025-08-20 05:12:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.302088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration:
857.102883ms
FAIL (2025-08-20 05:11:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.19599ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.469091085s
FAIL (2025-08-20 05:11:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.469123175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration:
879.532186ms
FAIL (2025-08-20 05:11:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.554439ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.334184677s
FAIL (2025-08-20 05:10:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.334317966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration:
973.160991ms
FAIL (2025-08-20 05:10:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 973.190574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration:
823.353106ms
FAIL (2025-08-20 05:10:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.387606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.392995687s
FAIL (2025-08-20 05:09:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.393027976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration:
831.296843ms
FAIL (2025-08-20 05:08:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.351052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.235732065s
FAIL (2025-08-20 05:08:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.235848716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.........................X.............X...................] duration:
874.391808ms
FAIL (2025-08-20 05:07:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.432151ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.720103084s
FAIL (2025-08-20 05:07:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.720143215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.........................X.............X..................] duration:
924.559888ms
FAIL (2025-08-20 05:07:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 924.586298ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.62201371s
FAIL (2025-08-20 05:06:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.622044071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.........................X.............X.................] duration:
1.061646665s
FAIL (2025-08-20 05:06:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.061673863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.37996667s
FAIL (2025-08-20 05:06:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.380064116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.........................X.............X................] duration:
816.990006ms
FAIL (2025-08-20 05:05:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.023478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.352752775s
FAIL (2025-08-20 05:05:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.352794206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.........................X.............X...............] duration:
1.263848025s
FAIL (2025-08-20 05:05:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.263883686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.790884115s
FAIL (2025-08-20 05:04:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.790921518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.328624546s
FAIL (2025-08-20 05:04:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.328681119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........................X.............X..............] duration:
1.085353111s
FAIL (2025-08-20 05:04:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.085379762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.322868751s
FAIL (2025-08-20 05:03:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.322901981s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.........................X.............X.............] duration:
884.286586ms
FAIL (2025-08-20 05:03:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.32192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.489714452s
FAIL (2025-08-20 05:02:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.489752881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........................X.............X............] duration:
874.893943ms
FAIL (2025-08-20 05:02:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.928494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.266509087s
FAIL (2025-08-20 05:01:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.266540882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.........................X.............X...........] duration:
913.403631ms
FAIL (2025-08-20 05:01:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 913.433371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........................X.............X..........] duration:
938.761586ms
FAIL (2025-08-20 05:01:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 938.795328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........................X.............X.........] duration:
906.490634ms
FAIL (2025-08-20 05:00:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 906.542724ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.........................X.................................] duration:
2.405166553s
FAIL (2025-08-20 05:00:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.405195646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........................X.............X........] duration:
1.310058589s
FAIL (2025-08-20 05:00:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.310096913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.........................X................................] duration:
2.464667527s
FAIL (2025-08-20 04:59:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.464705217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.........................X...............................] duration:
2.348279541s
FAIL (2025-08-20 04:59:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.348345169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.........................X.............X.......] duration:
850.516129ms
FAIL (2025-08-20 04:59:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.565366ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........................X.............X......] duration:
819.544836ms
FAIL (2025-08-20 04:58:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.598728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.........................X..............................] duration:
2.405236934s
FAIL (2025-08-20 04:58:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.405268747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.........................X.............................] duration:
2.498040005s
FAIL (2025-08-20 04:57:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.498073869s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........................X.............X.....] duration:
847.867066ms
FAIL (2025-08-20 04:57:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.912098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........................X............................] duration:
2.547805408s
FAIL (2025-08-20 04:56:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.547840681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........................X.............X....] duration:
891.979791ms
FAIL (2025-08-20 04:56:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.013248ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.........................X.............X...] duration:
825.236615ms
FAIL (2025-08-20 04:56:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.272747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.........................X...........................] duration:
2.363947543s
FAIL (2025-08-20 04:55:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.363979212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........................X..........................] duration:
2.715575923s
FAIL (2025-08-20 04:55:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.71561364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........................X.............X..] duration:
815.211235ms
FAIL (2025-08-20 04:54:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.238484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.......X.........................X.........................] duration:
2.484731532s
FAIL (2025-08-20 04:54:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.484766341s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........................X.............X.] duration:
989.441634ms
FAIL (2025-08-20 04:53:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.477307ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X.........................X........................] duration:
2.244058658s
FAIL (2025-08-20 04:53:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.244087125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X.........................X.......................] duration:
2.320638828s
FAIL (2025-08-20 04:52:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.320662585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........................X.............X] duration:
356.863504ms
FAIL (2025-08-20 04:52:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 356.892008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|