Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.X..........XX...........................................] duration:
841.136921ms
FAIL (2025-08-11 07:26:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 841.165174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................X.X..X.............] duration:
2.351806557s
FAIL (2025-08-11 07:25:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.351834445s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.X..........XX..........................................] duration:
829.799523ms
FAIL (2025-08-11 07:24:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 829.830748ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.........................................X.X..X............] duration:
2.39612132s
FAIL (2025-08-11 07:24:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.396166846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.X..........XX.........................................] duration:
1.037691386s
FAIL (2025-08-11 07:23:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 1.037725703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.........................................X.X..X...........] duration:
2.354117922s
FAIL (2025-08-11 07:23:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.354154177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.........................................X.X..X..........] duration:
2.422357884s
FAIL (2025-08-11 07:23:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.422465013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.X..........XX........................................] duration:
822.946789ms
FAIL (2025-08-11 07:23:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 822.989834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.X..........XX.......................................] duration:
869.439069ms
FAIL (2025-08-11 07:22:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 869.483625ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.........................................X.X..X.........] duration:
2.236016247s
FAIL (2025-08-11 07:21:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.236045616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.........................................X.X..X........] duration:
2.224519673s
FAIL (2025-08-11 07:21:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.224550412s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X..........XX......................................] duration:
817.007227ms
FAIL (2025-08-11 07:21:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 817.033429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........................................X.X..X.......] duration:
2.377499766s
FAIL (2025-08-11 07:21:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.377528867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.X..........XX.....................................] duration:
1.077837433s
FAIL (2025-08-11 07:20:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 1.077873857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.....X.........................................X.X..X......] duration:
2.286207504s
FAIL (2025-08-11 07:20:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.2862375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X..........XX....................................] duration:
816.761585ms
FAIL (2025-08-11 07:20:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 816.799286ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X..........XX...................................] duration:
969.651456ms
FAIL (2025-08-11 07:19:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 969.68763ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.....X.........................................X.X..X.....] duration:
2.342433825s
FAIL (2025-08-11 07:19:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.342462743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.X..........XX..................................] duration:
839.844258ms
FAIL (2025-08-11 07:19:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 839.872374ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.....X.........................................X.X..X....] duration:
2.320255949s
FAIL (2025-08-11 07:18:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.320288735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.X..........XX.................................] duration:
857.245948ms
FAIL (2025-08-11 07:18:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 857.282908ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.....X.........................................X.X..X...] duration:
2.333539965s
FAIL (2025-08-11 07:18:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.33358374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.....X.........................................X.X..X..] duration:
2.306114458s
FAIL (2025-08-11 07:17:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.30614099s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X............X.X..........XX................................] duration:
837.817106ms
FAIL (2025-08-11 07:17:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 837.84487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.....X.........................................X.X..X.] duration:
2.279572606s
FAIL (2025-08-11 07:17:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.279595717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.....X.........................................X.X..X] duration:
2.236389923s
FAIL (2025-08-11 07:16:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12410691dede20b61291e1aad6efac6fc38e5362e6655cc8cd534e06548861b4 != before e173ede5d29720a2bda58da1b47315da45437f5fc4ad480a4707f70d8b384f0e
======LOGS======
Aug 11 07:16:51.131933558 (61h51m13.091030795s) [upload=64429]: Starting upload
Aug 11 07:16:51.132008907 (61h51m13.091106155s) [upload=64429]: Done starting upload
Aug 11 07:16:51.132136805 (61h51m13.091234065s) [upload=64429]: Uploading segments...
Aug 11 07:16:51.132278204 (61h51m13.091375461s) [upload=64429]: Got next segment. Inline: false
Aug 11 07:16:51.132329099 (61h51m13.091426351s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:16:51.132334698 (61h51m13.091431944s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:16:51.327686131 (61h51m13.28678338s) [seg_pos={0 0}, upload=64429]: Begin upload segment...
Aug 11 07:16:51.327747800 (61h51m13.286845035s) [seg_pos={0 0}, upload=64429]: Done begin upload segment.
Aug 11 07:16:51.327777485 (61h51m13.286874737s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328278232 (61h51m13.28737548s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328554804 (61h51m13.287652052s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328825889 (61h51m13.287923135s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.328916466 (61h51m13.288013724s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.329672430 (61h51m13.288769684s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.330668113 (61h51m13.289765365s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331141765 (61h51m13.29023902s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331453197 (61h51m13.290550447s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.331844114 (61h51m13.290941369s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332175142 (61h51m13.291272387s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332449311 (61h51m13.291546559s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.332780293 (61h51m13.291877547s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333119754 (61h51m13.292217018s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333459326 (61h51m13.292556582s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.333818105 (61h51m13.29291535s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334151921 (61h51m13.293249157s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.334446808 (61h51m13.293544059s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Uploading piece...
Aug 11 07:16:51.892793797 (61h51m13.851891035s) [upload=64429]: Next returned nil segment
Aug 11 07:16:51.892812688 (61h51m13.85190994s) [upload=64429]: Waiting for error group managing segments...
Aug 11 07:16:52.060461629 (61h51m14.019558874s) [noise=true , address=104.36.82.61:4393 , piece_id=J7CMCTPWXVKDBZNRPC35USGQVMEBSBTKZOB3MV3SO7M5NFNPKVUQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.064427346 (61h51m14.023524592s) [noise=true , address=104.36.82.39:4735 , piece_id=HWPRAXCSM3IXGNMADOWMFWIMDFGUPTRCPTGQDJ2FTAZUHPN5R6BA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.065229351 (61h51m14.024326598s) [noise=true , address=104.36.82.3:4797 , piece_id=7SCVCTWFNB6DEOTXYMJVW6RQFMJJSEW2KW2UO6HY5CXIFNXSI6YQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.067056821 (61h51m14.026154058s) [noise=true , address=104.36.82.23:4465 , piece_id=HONWV2SERGUF4G2E6WODDPV2BRYL35ES2KKX56HYFINJY7QG4LIA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.071766881 (61h51m14.030864127s) [noise=true , address=104.36.82.49:4003 , piece_id=6BDOFO2ZGD3F62QG4STLUKKFPCHUEDNX65D7DDMJO2LV5GLL4I5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072013290 (61h51m14.031110529s) [noise=true , address=104.36.82.17:4343 , piece_id=UA7V25WNTYB5TQVCOQG2NQ7SWXXJL6MP6GK7UGUWRPILKZEOCTZA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.072242998 (61h51m14.031340237s) [noise=true , address=104.36.82.37:4658 , piece_id=XN33SCJA4IF3TTRHF4A7B7CUBQXADKUNXY2BFOHOZBED7FWA3ALQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.074495652 (61h51m14.033592898s) [noise=true , address=104.36.82.8:4998 , piece_id=IWSIXYOL3DUADSKP4YDNYFNN5VGWFKQDJT7LEZ4IQLUMTVQONFGQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.080059253 (61h51m14.039156492s) [noise=true , address=104.36.82.38:4697 , piece_id=MKRLOPSGIQOKKSYVECL6UL5HIXR2ATULRRN5FHSLWDYRZTF2EG5A, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084351326 (61h51m14.043448558s) [noise=true , address=104.36.82.58:4278 , piece_id=RY7DV5F5SNFATBMDGMJPTSUVCEW22SAQLVYVU7SNRGYIZINB65BQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.084671429 (61h51m14.043768668s) [noise=true , address=77.90.31.13:4631 , piece_id=J6SZHNY6LIOWRUZTMUUNFSLD5N6TJ2QS6TKXHBMJL4LCB32WHURA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.089797424 (61h51m14.048894676s) [noise=true , address=104.36.82.60:4353 , piece_id=5GMYYBI2F4A34VP2ULWRV7ECACXX3BSBUAV23ANEMKJ6K6ZDB67Q, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.095119881 (61h51m14.054217116s) [noise=true , address=104.36.82.5:4852 , piece_id=4AO22AMZ6T5XTQRGIFJXCJBPQ6KDODLOF7VDFVDWNEDHBKC35CJA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108342909 (61h51m14.067440141s) [noise=true , address=104.36.82.18:4385 , piece_id=3YBNAJ5WOTW7OIOR2D2FMO35T34RNKHPDLOLUGWGALPIVKPKLECQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: <nil>
Aug 11 07:16:52.108386880 (61h51m14.067484128s) [seg_pos={0 0}, upload=64429]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:16:52.108671480 (61h51m14.067768713s) [noise=true , address=104.36.82.58:4267 , piece_id=JLDWCQLAN4ORNMT33DJ2QSMGCGUTPKB7QOHF5FZ6DTSRCVWCS2EA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ektWku5yW6MRm2Rph8kiAAuifJJWZUMopaA3gcwStUfY6Nax8): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108778724 (61h51m14.067875956s) [noise=true , address=104.36.82.35:4585 , piece_id=X5PP5JWU5BPXLQCFBWK7ANJCDRRPBBAW2HAN4NQ3ZTWABAAFDOSA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108871543 (61h51m14.067968777s) [noise=true , address=104.36.82.44:4897 , piece_id=I2KYVUXRKYD4Y7Z6DZQJHWYDKNGKPBVPRAVIW5GOWVIHI3YDINQQ, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 11 07:16:52.108988899 (61h51m14.068086132s) [noise=true , address=64.49.13.27:4961 , piece_id=AFXGZQMGFADHYV7A755VSBEPBXVZJXB3XTRNT45KNUHQC7M5PKRA, seg_pos={0 0}, upload=64429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SwCHMdLXowSBhg3UtVahaWWAQ5TJYZ7yUSdAQ8Q8Cv3qWwMnt): protocol: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55216->64.49.13.27:4961: use of closed network connection
Aug 11 07:16:52.109015126 (61h51m14.068112359s) [seg_pos={0 0}, upload=64429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:16:52.109104185 (61h51m14.068201417s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:16:52.109109171 (61h51m14.068206418s) [upload=64429]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:16:52.255471473 (61h51m14.214568728s) [upload=64429]: Done uploading segments...
Aug 11 07:16:52.255497417 (61h51m14.214594673s) [upload=64429]: Upload finished. err: <nil>
Duration: 2.236424594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X............X.X..........XX...............................] duration:
993.881547ms
FAIL (2025-08-11 07:16:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 993.89807ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X............X.X..........XX..............................] duration:
813.71144ms
FAIL (2025-08-11 07:16:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 813.748358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.....X.........................................X.X..] duration:
2.367800639s
FAIL (2025-08-11 07:15:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after baa13512afb52bfab61547da93071581df4aa103c34b16133b16e470e41b910b != before c3f3d65ee15588730be1c39a08099ed60bbe67de3b6ea9fa32395cc9db63dcbb
======LOGS======
Aug 11 07:14:32.563568959 (61h48m54.522666195s) [upload=64384]: Starting upload
Aug 11 07:14:32.563679890 (61h48m54.522777137s) [upload=64384]: Done starting upload
Aug 11 07:14:32.563778114 (61h48m54.52287535s) [upload=64384]: Uploading segments...
Aug 11 07:14:32.564256207 (61h48m54.523353445s) [upload=64384]: Got next segment. Inline: false
Aug 11 07:14:32.564293639 (61h48m54.523390885s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:14:32.564299722 (61h48m54.523396968s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:14:32.757564200 (61h48m54.716661446s) [seg_pos={0 0}, upload=64384]: Begin upload segment...
Aug 11 07:14:32.757624676 (61h48m54.716721925s) [seg_pos={0 0}, upload=64384]: Done begin upload segment.
Aug 11 07:14:32.757654686 (61h48m54.716751932s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758239906 (61h48m54.717337157s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758693490 (61h48m54.71779074s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759128893 (61h48m54.718226142s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759581653 (61h48m54.718678903s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759827640 (61h48m54.718924893s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760259517 (61h48m54.71935677s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760671856 (61h48m54.719769101s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761015070 (61h48m54.720112325s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761407521 (61h48m54.720504776s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761817724 (61h48m54.720914962s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762288725 (61h48m54.72138598s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762608666 (61h48m54.721705914s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763045412 (61h48m54.722142663s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763457994 (61h48m54.722555248s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763849454 (61h48m54.722946704s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764141578 (61h48m54.723238823s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764448751 (61h48m54.723546005s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:33.333175523 (61h48m55.292272771s) [upload=64384]: Next returned nil segment
Aug 11 07:14:33.333196719 (61h48m55.292293965s) [upload=64384]: Waiting for error group managing segments...
Aug 11 07:14:33.474048885 (61h48m55.433146124s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.485192449 (61h48m55.4442897s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.486270758 (61h48m55.445367994s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.501443324 (61h48m55.46054058s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.502854059 (61h48m55.461951305s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.503344606 (61h48m55.462441846s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.505931116 (61h48m55.465028362s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.507352846 (61h48m55.466450089s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.508747794 (61h48m55.46784503s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.511360757 (61h48m55.470457994s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.513886510 (61h48m55.472983746s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.514813139 (61h48m55.473910386s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.532242704 (61h48m55.491339959s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537193199 (61h48m55.496290435s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537227047 (61h48m55.496324294s) [seg_pos={0 0}, upload=64384]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:14:33.537458792 (61h48m55.496556037s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537543024 (61h48m55.49664027s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JXYpLarXKLWgAMdNhxWfTWb9VYWGyaY4yLGtqXAWcCBAYJRZY): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537591413 (61h48m55.496688668s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection
Aug 11 07:14:33.537636393 (61h48m55.496733628s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection
Aug 11 07:14:33.537651662 (61h48m55.496748896s) [seg_pos={0 0}, upload=64384]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:14:33.537738564 (61h48m55.4968358s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:14:33.537744108 (61h48m55.496841355s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:14:33.681730412 (61h48m55.640827658s) [upload=64384]: Done uploading segments...
Aug 11 07:14:33.681752901 (61h48m55.640850147s) [upload=64384]: Upload finished. err: <nil>
Duration: 2.367837145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.......X.....X.........................................X.X.] duration:
2.43430139s
FAIL (2025-08-11 07:15:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after baa13512afb52bfab61547da93071581df4aa103c34b16133b16e470e41b910b != before c3f3d65ee15588730be1c39a08099ed60bbe67de3b6ea9fa32395cc9db63dcbb
======LOGS======
Aug 11 07:14:32.563568959 (61h48m54.522666195s) [upload=64384]: Starting upload
Aug 11 07:14:32.563679890 (61h48m54.522777137s) [upload=64384]: Done starting upload
Aug 11 07:14:32.563778114 (61h48m54.52287535s) [upload=64384]: Uploading segments...
Aug 11 07:14:32.564256207 (61h48m54.523353445s) [upload=64384]: Got next segment. Inline: false
Aug 11 07:14:32.564293639 (61h48m54.523390885s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:14:32.564299722 (61h48m54.523396968s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:14:32.757564200 (61h48m54.716661446s) [seg_pos={0 0}, upload=64384]: Begin upload segment...
Aug 11 07:14:32.757624676 (61h48m54.716721925s) [seg_pos={0 0}, upload=64384]: Done begin upload segment.
Aug 11 07:14:32.757654686 (61h48m54.716751932s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758239906 (61h48m54.717337157s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758693490 (61h48m54.71779074s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759128893 (61h48m54.718226142s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759581653 (61h48m54.718678903s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759827640 (61h48m54.718924893s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760259517 (61h48m54.71935677s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760671856 (61h48m54.719769101s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761015070 (61h48m54.720112325s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761407521 (61h48m54.720504776s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761817724 (61h48m54.720914962s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762288725 (61h48m54.72138598s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762608666 (61h48m54.721705914s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763045412 (61h48m54.722142663s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763457994 (61h48m54.722555248s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763849454 (61h48m54.722946704s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764141578 (61h48m54.723238823s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764448751 (61h48m54.723546005s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:33.333175523 (61h48m55.292272771s) [upload=64384]: Next returned nil segment
Aug 11 07:14:33.333196719 (61h48m55.292293965s) [upload=64384]: Waiting for error group managing segments...
Aug 11 07:14:33.474048885 (61h48m55.433146124s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.485192449 (61h48m55.4442897s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.486270758 (61h48m55.445367994s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.501443324 (61h48m55.46054058s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.502854059 (61h48m55.461951305s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.503344606 (61h48m55.462441846s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.505931116 (61h48m55.465028362s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.507352846 (61h48m55.466450089s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.508747794 (61h48m55.46784503s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.511360757 (61h48m55.470457994s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.513886510 (61h48m55.472983746s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.514813139 (61h48m55.473910386s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.532242704 (61h48m55.491339959s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537193199 (61h48m55.496290435s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537227047 (61h48m55.496324294s) [seg_pos={0 0}, upload=64384]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:14:33.537458792 (61h48m55.496556037s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537543024 (61h48m55.49664027s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JXYpLarXKLWgAMdNhxWfTWb9VYWGyaY4yLGtqXAWcCBAYJRZY): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537591413 (61h48m55.496688668s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection
Aug 11 07:14:33.537636393 (61h48m55.496733628s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection
Aug 11 07:14:33.537651662 (61h48m55.496748896s) [seg_pos={0 0}, upload=64384]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:14:33.537738564 (61h48m55.4968358s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:14:33.537744108 (61h48m55.496841355s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:14:33.681730412 (61h48m55.640827658s) [upload=64384]: Done uploading segments...
Aug 11 07:14:33.681752901 (61h48m55.640850147s) [upload=64384]: Upload finished. err: <nil>
Duration: 2.43433529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X............X.X..........XX.............................] duration:
898.04433ms
FAIL (2025-08-11 07:15:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 898.083244ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X............X.X..........XX............................] duration:
926.851805ms
FAIL (2025-08-11 07:14:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 926.889835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X............X.X..........XX...........................] duration:
828.275371ms
FAIL (2025-08-11 07:14:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 828.314071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.......X.....X.........................................X.X] duration:
2.294693378s
FAIL (2025-08-11 07:14:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after baa13512afb52bfab61547da93071581df4aa103c34b16133b16e470e41b910b != before c3f3d65ee15588730be1c39a08099ed60bbe67de3b6ea9fa32395cc9db63dcbb
======LOGS======
Aug 11 07:14:32.563568959 (61h48m54.522666195s) [upload=64384]: Starting upload
Aug 11 07:14:32.563679890 (61h48m54.522777137s) [upload=64384]: Done starting upload
Aug 11 07:14:32.563778114 (61h48m54.52287535s) [upload=64384]: Uploading segments...
Aug 11 07:14:32.564256207 (61h48m54.523353445s) [upload=64384]: Got next segment. Inline: false
Aug 11 07:14:32.564293639 (61h48m54.523390885s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:14:32.564299722 (61h48m54.523396968s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:14:32.757564200 (61h48m54.716661446s) [seg_pos={0 0}, upload=64384]: Begin upload segment...
Aug 11 07:14:32.757624676 (61h48m54.716721925s) [seg_pos={0 0}, upload=64384]: Done begin upload segment.
Aug 11 07:14:32.757654686 (61h48m54.716751932s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758239906 (61h48m54.717337157s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.758693490 (61h48m54.71779074s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759128893 (61h48m54.718226142s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759581653 (61h48m54.718678903s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.759827640 (61h48m54.718924893s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760259517 (61h48m54.71935677s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.760671856 (61h48m54.719769101s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761015070 (61h48m54.720112325s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761407521 (61h48m54.720504776s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.761817724 (61h48m54.720914962s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762288725 (61h48m54.72138598s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.762608666 (61h48m54.721705914s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763045412 (61h48m54.722142663s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763457994 (61h48m54.722555248s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.763849454 (61h48m54.722946704s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764141578 (61h48m54.723238823s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:32.764448751 (61h48m54.723546005s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Uploading piece...
Aug 11 07:14:33.333175523 (61h48m55.292272771s) [upload=64384]: Next returned nil segment
Aug 11 07:14:33.333196719 (61h48m55.292293965s) [upload=64384]: Waiting for error group managing segments...
Aug 11 07:14:33.474048885 (61h48m55.433146124s) [noise=true , address=45.91.116.13:4171 , piece_id=CBRZWGT7KMUUDKRJ27FHDCJY6DZOWNWQTSRDNDZZMNY46PD4Y7JA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.485192449 (61h48m55.4442897s) [noise=true , address=77.90.31.19:4863 , piece_id=RWT4PF22W3AM32YHOM5G3NESEHOOS35FU23P7PWAZ734MAZ52W2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.486270758 (61h48m55.445367994s) [noise=true , address=104.36.82.47:4524 , piece_id=7BCUU7H5UVGYQ2M3WD2UFLORF6DBK65SL2QJ2WGP3VFYKYYJUTFA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.501443324 (61h48m55.46054058s) [noise=true , address=104.36.82.16:4300 , piece_id=DJB6YSTFSVIIJE7T3LMPW6LV2BQ5EIUB2E5DW2FJOQOHLXSRRMAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.502854059 (61h48m55.461951305s) [noise=true , address=104.36.82.11:4126 , piece_id=FRSUCS2BB34IBK2ULVB45C3T5SAXQCSCFN5SOAR3435QSL2LV3LA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.503344606 (61h48m55.462441846s) [noise=true , address=104.36.82.35:4616 , piece_id=K43PHGTQHA5XGM33DTPWDOUPZ2VJBPK323ITBSHFSM33N4T6BFBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.505931116 (61h48m55.465028362s) [noise=true , address=104.36.82.44:4871 , piece_id=QMIAF2W54PSOELZ5KOAJD3JIPRW4ZAC4NBZX7OA4DP4EBPX3GP6A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.507352846 (61h48m55.466450089s) [noise=true , address=104.36.82.5:4853 , piece_id=DS4IDCL7TEIL7GUBMILVHJGU7TYEWODMMJ4SPNADCJEIU3K7YCGQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.508747794 (61h48m55.46784503s) [noise=true , address=104.36.82.62:4432 , piece_id=EMGKX42ISWAYMIOPLTYPHRUV2453NUIFFVTVAGN57N4WKL5DL5HQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.511360757 (61h48m55.470457994s) [noise=true , address=104.36.82.23:4450 , piece_id=SKT2BBH2OGB3XWD7IN67WZQEB7NLUZ7CCF4X3VEZDL22JCJGIDEQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.513886510 (61h48m55.472983746s) [noise=true , address=104.36.82.38:4707 , piece_id=SU6E7WU66GY3Q2AXRGIYZ5ZKZZJIKC4FE77RKY6RZ55X5QIZHXVA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.514813139 (61h48m55.473910386s) [noise=true , address=104.36.82.60:4367 , piece_id=MR4IKYLMKT6DB37CSJUKVXVTLJOROVSNJLFNE7ZU56NIN4536V2A, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.532242704 (61h48m55.491339959s) [noise=true , address=104.36.82.8:4985 , piece_id=2MEPSQSIJVYHNFEJM3SCZDH52RIWPLFGGZFSHQLU7TB3WVFMPEBQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537193199 (61h48m55.496290435s) [noise=true , address=77.90.31.11:4584 , piece_id=TLTZRMZZJLFBOFNEAPCZNIUI5BTVF2OWAKJLKK3RZDSXPILHQK4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: <nil>
Aug 11 07:14:33.537227047 (61h48m55.496324294s) [seg_pos={0 0}, upload=64384]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:14:33.537458792 (61h48m55.496556037s) [noise=true , address=104.36.82.37:4672 , piece_id=3S6FTQH6B4ZHZ6X3QLUDRB5RVMSZOEONXNBWLAG7FMS6R5GOFFJQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G9dUkPkLRrEkMGsTiaN9iB8YnZ9GF7moCUPhGiu1XDDi8XnSu): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537543024 (61h48m55.49664027s) [noise=true , address=104.36.82.59:4328 , piece_id=7DJLZSS4SZTMYAJIG5VX6KTD6GFO2SRE43LD3W4CDECKKGJVOJAA, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JXYpLarXKLWgAMdNhxWfTWb9VYWGyaY4yLGtqXAWcCBAYJRZY): protocol: expected piece hash; context canceled; EOF
Aug 11 07:14:33.537591413 (61h48m55.496688668s) [noise=true , address=64.49.13.140:4511 , piece_id=URUNVKMPLBGSWXIEFFML3BPO7HM7N34A5X3CS5O6GE7WWUFMT6LQ, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33558->64.49.13.140:4511: use of closed network connection
Aug 11 07:14:33.537636393 (61h48m55.496733628s) [noise=true , address=64.49.13.140:4505 , piece_id=VC7CYIIDPMQWYNESY66WLPENJISGOKFMGXZ4M7OBZVPWPSN4RS4Q, seg_pos={0 0}, upload=64384]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50184->64.49.13.140:4505: use of closed network connection
Aug 11 07:14:33.537651662 (61h48m55.496748896s) [seg_pos={0 0}, upload=64384]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:14:33.537738564 (61h48m55.4968358s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:14:33.537744108 (61h48m55.496841355s) [upload=64384]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:14:33.681730412 (61h48m55.640827658s) [upload=64384]: Done uploading segments...
Aug 11 07:14:33.681752901 (61h48m55.640850147s) [upload=64384]: Upload finished. err: <nil>
Duration: 2.294729585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X............X.X..........XX..........................] duration:
825.292337ms
FAIL (2025-08-11 07:14:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 825.469941ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X............X.X..........XX.........................] duration:
895.923529ms
FAIL (2025-08-11 07:14:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 895.951235ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.......X.....X.........................................X.] duration:
2.404589669s
FAIL (2025-08-11 07:13:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 07:13:25.058282885 (61h47m47.017380157s) [upload=64362]: Starting upload
Aug 11 07:13:25.058343393 (61h47m47.017440645s) [upload=64362]: Done starting upload
Aug 11 07:13:25.058595363 (61h47m47.017692601s) [upload=64362]: Uploading segments...
Aug 11 07:13:25.058637675 (61h47m47.017734929s) [upload=64362]: Got next segment. Inline: false
Aug 11 07:13:25.058668131 (61h47m47.017765376s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:13:25.058673136 (61h47m47.017770371s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:13:25.304068276 (61h47m47.263165521s) [seg_pos={0 0}, upload=64362]: Begin upload segment...
Aug 11 07:13:25.304205637 (61h47m47.263302868s) [seg_pos={0 0}, upload=64362]: Done begin upload segment.
Aug 11 07:13:25.304244409 (61h47m47.263341664s) [noise=true , address=104.36.82.19:4434 , piece_id=VH6ND4EPW5ERAMN7JX4TSVRI2FLKDFC7WRJLRNJBUSLIQF6MN7ZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304256689 (61h47m47.263353934s) [noise=true , address=104.36.82.47:4522 , piece_id=25UJWGO2K3FBYMTEWCW5SPA7VC5CMQX54D3FRJYKDBGSTH3RSDBQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304879647 (61h47m47.263976893s) [noise=true , address=104.36.82.8:4984 , piece_id=H7I45XI3C4ZD5DMFECNB666RKPMBWV7JA7OCYDYZZ5TFHPK4MCXA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304891778 (61h47m47.263989034s) [noise=true , address=193.149.164.143:4695 , piece_id=ALHXDSMWAC6TORJ27XGQMYS2GKSFACH2J2FYVVEPKQQQIVH34RZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.305415448 (61h47m47.264512697s) [noise=true , address=64.49.13.155:4914 , piece_id=CW62F6BP4SGUBJSGMJIEB2GALUYBG4ADCMMXDFK5T36WADD3HMLQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.306047339 (61h47m47.265144586s) [noise=true , address=104.36.82.61:4387 , piece_id=N4VKGWLIZLZ5YEJY5NGTSDTDJ3F7K445SR4E7HPEO4JBLNPBVZJQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.306780679 (61h47m47.265877925s) [noise=true , address=104.36.82.34:4570 , piece_id=L6SHQIS3MAFED2ZXGCIESIPAHYQFZZYZ7N2GXROUVA2D5YA4C7WQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.307357189 (61h47m47.266454435s) [noise=true , address=104.36.82.52:4117 , piece_id=O6BLM7HUE6LGNJEAS7F3KYYQHCMRH7NGOSYNJST3G4C6ENTRC6PQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.307541549 (61h47m47.266638794s) [noise=true , address=104.36.82.39:4735 , piece_id=KOM4JXXCYCXXRLDAR3AUGLJK2TIP777VDTQYTIGGSTPGK5T2GSOQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308048479 (61h47m47.267145728s) [noise=true , address=64.49.13.140:4516 , piece_id=6VK4IWDT5ZZFTNDLULF5OYMGYDE35BASS47H3KUD535I6HRZMYPQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308417525 (61h47m47.267514777s) [noise=true , address=45.91.116.5:4319 , piece_id=JBTG6OWMF7IW2ZO4WFLZNNOWX2ZBXIEOJJE4ZAAN45KLMNJL7BKQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308858400 (61h47m47.267955685s) [noise=true , address=104.36.82.37:4678 , piece_id=SFVTDFFR3QYMFBIV5L36NPPVJ4LU3VSKXOZ6W7VKM4QY3H2J5C3Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.309308853 (61h47m47.268406109s) [noise=true , address=104.36.82.60:4361 , piece_id=EXMTV7NEXUYFNYWYH273D356L3TL6G2KWRYNA6CE3KEVMPCVPOMA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.309746358 (61h47m47.268843613s) [noise=true , address=104.36.82.38:4707 , piece_id=PTXX6JYDMYD7RNCNMLMC3JVU24QKB56MQZV3MRG5JFWOYIUL3HZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310147073 (61h47m47.269244321s) [noise=true , address=104.36.82.62:4430 , piece_id=JCI7BNKY3NFLKD63QMR6T3QBPSUFTHGGJUCTBZNEVUZIXT35WTUQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310472601 (61h47m47.269569846s) [noise=true , address=104.36.82.59:4319 , piece_id=YVIQPYHE3MN5KFJLSQKUWA6RKLFLC3VXDSH7XTNXT77EW3XKNV2A, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310803180 (61h47m47.269900449s) [noise=true , address=104.36.82.46:4511 , piece_id=Z5DTRZLZ3A2MXQJN5PA3JNYEESWS46T57T3U5H2GNOB6HYE2TK3Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.311365894 (61h47m47.270463132s) [noise=true , address=104.36.82.38:4724 , piece_id=C4KN7734QM4FL63NNQZCXZ5GWQIWK25OZEJPMETKXYI4BV6HPU7Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.879874489 (61h47m47.838971734s) [upload=64362]: Next returned nil segment
Aug 11 07:13:25.879908578 (61h47m47.839005822s) [upload=64362]: Waiting for error group managing segments...
Aug 11 07:13:26.032633304 (61h47m47.991730538s) [noise=true , address=104.36.82.37:4678 , piece_id=SFVTDFFR3QYMFBIV5L36NPPVJ4LU3VSKXOZ6W7VKM4QY3H2J5C3Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.036252942 (61h47m47.995350188s) [noise=true , address=104.36.82.38:4724 , piece_id=C4KN7734QM4FL63NNQZCXZ5GWQIWK25OZEJPMETKXYI4BV6HPU7Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.037695400 (61h47m47.996792638s) [noise=true , address=104.36.82.39:4735 , piece_id=KOM4JXXCYCXXRLDAR3AUGLJK2TIP777VDTQYTIGGSTPGK5T2GSOQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.038637828 (61h47m47.997735068s) [noise=true , address=104.36.82.61:4387 , piece_id=N4VKGWLIZLZ5YEJY5NGTSDTDJ3F7K445SR4E7HPEO4JBLNPBVZJQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.045893664 (61h47m48.004990909s) [noise=true , address=45.91.116.5:4319 , piece_id=JBTG6OWMF7IW2ZO4WFLZNNOWX2ZBXIEOJJE4ZAAN45KLMNJL7BKQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.047276255 (61h47m48.0063735s) [noise=true , address=104.36.82.62:4430 , piece_id=JCI7BNKY3NFLKD63QMR6T3QBPSUFTHGGJUCTBZNEVUZIXT35WTUQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.047377178 (61h47m48.006474412s) [noise=true , address=104.36.82.8:4984 , piece_id=H7I45XI3C4ZD5DMFECNB666RKPMBWV7JA7OCYDYZZ5TFHPK4MCXA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.051860078 (61h47m48.010957327s) [noise=true , address=104.36.82.19:4434 , piece_id=VH6ND4EPW5ERAMN7JX4TSVRI2FLKDFC7WRJLRNJBUSLIQF6MN7ZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.052252913 (61h47m48.011350149s) [noise=true , address=104.36.82.34:4570 , piece_id=L6SHQIS3MAFED2ZXGCIESIPAHYQFZZYZ7N2GXROUVA2D5YA4C7WQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.052631036 (61h47m48.011728284s) [noise=true , address=104.36.82.59:4319 , piece_id=YVIQPYHE3MN5KFJLSQKUWA6RKLFLC3VXDSH7XTNXT77EW3XKNV2A, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.053007186 (61h47m48.012104425s) [noise=true , address=104.36.82.38:4707 , piece_id=PTXX6JYDMYD7RNCNMLMC3JVU24QKB56MQZV3MRG5JFWOYIUL3HZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.054063000 (61h47m48.013160243s) [noise=true , address=104.36.82.47:4522 , piece_id=25UJWGO2K3FBYMTEWCW5SPA7VC5CMQX54D3FRJYKDBGSTH3RSDBQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059265640 (61h47m48.018362878s) [noise=true , address=104.36.82.46:4511 , piece_id=Z5DTRZLZ3A2MXQJN5PA3JNYEESWS46T57T3U5H2GNOB6HYE2TK3Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059317136 (61h47m48.018414381s) [noise=true , address=104.36.82.60:4361 , piece_id=EXMTV7NEXUYFNYWYH273D356L3TL6G2KWRYNA6CE3KEVMPCVPOMA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059323724 (61h47m48.018420963s) [seg_pos={0 0}, upload=64362]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:13:26.059465171 (61h47m48.018562409s) [noise=true , address=104.36.82.52:4117 , piece_id=O6BLM7HUE6LGNJEAS7F3KYYQHCMRH7NGOSYNJST3G4C6ENTRC6PQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QVEhFpjfLubGsZmoY1XQdDWevLy2xWdjtPq4JnbSYuBgEXgz7): protocol: expected piece hash; context canceled; EOF
Aug 11 07:13:26.059577068 (61h47m48.018674304s) [noise=true , address=64.49.13.140:4516 , piece_id=6VK4IWDT5ZZFTNDLULF5OYMGYDE35BASS47H3KUD535I6HRZMYPQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection
Aug 11 07:13:26.059662131 (61h47m48.018759369s) [noise=true , address=193.149.164.143:4695 , piece_id=ALHXDSMWAC6TORJ27XGQMYS2GKSFACH2J2FYVVEPKQQQIVH34RZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TZfgz24gnZr4UryzEKw6gu94njnmCvafX5X64MKFSJqaUWSVh): protocol: write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection; write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection
Aug 11 07:13:26.059669068 (61h47m48.018766314s) [noise=true , address=64.49.13.155:4914 , piece_id=CW62F6BP4SGUBJSGMJIEB2GALUYBG4ADCMMXDFK5T36WADD3HMLQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection; write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection
Aug 11 07:13:26.059702626 (61h47m48.018799877s) [seg_pos={0 0}, upload=64362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:13:26.059813221 (61h47m48.018910468s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:13:26.059820171 (61h47m48.018917417s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:13:26.209063727 (61h47m48.168160975s) [upload=64362]: Done uploading segments...
Aug 11 07:13:26.209083076 (61h47m48.16818031s) [upload=64362]: Upload finished. err: <nil>
Duration: 2.404642533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.......X.....X.........................................X] duration:
1.623891002s
FAIL (2025-08-11 07:13:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 07:13:25.058282885 (61h47m47.017380157s) [upload=64362]: Starting upload
Aug 11 07:13:25.058343393 (61h47m47.017440645s) [upload=64362]: Done starting upload
Aug 11 07:13:25.058595363 (61h47m47.017692601s) [upload=64362]: Uploading segments...
Aug 11 07:13:25.058637675 (61h47m47.017734929s) [upload=64362]: Got next segment. Inline: false
Aug 11 07:13:25.058668131 (61h47m47.017765376s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 07:13:25.058673136 (61h47m47.017770371s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 07:13:25.304068276 (61h47m47.263165521s) [seg_pos={0 0}, upload=64362]: Begin upload segment...
Aug 11 07:13:25.304205637 (61h47m47.263302868s) [seg_pos={0 0}, upload=64362]: Done begin upload segment.
Aug 11 07:13:25.304244409 (61h47m47.263341664s) [noise=true , address=104.36.82.19:4434 , piece_id=VH6ND4EPW5ERAMN7JX4TSVRI2FLKDFC7WRJLRNJBUSLIQF6MN7ZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304256689 (61h47m47.263353934s) [noise=true , address=104.36.82.47:4522 , piece_id=25UJWGO2K3FBYMTEWCW5SPA7VC5CMQX54D3FRJYKDBGSTH3RSDBQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304879647 (61h47m47.263976893s) [noise=true , address=104.36.82.8:4984 , piece_id=H7I45XI3C4ZD5DMFECNB666RKPMBWV7JA7OCYDYZZ5TFHPK4MCXA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.304891778 (61h47m47.263989034s) [noise=true , address=193.149.164.143:4695 , piece_id=ALHXDSMWAC6TORJ27XGQMYS2GKSFACH2J2FYVVEPKQQQIVH34RZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.305415448 (61h47m47.264512697s) [noise=true , address=64.49.13.155:4914 , piece_id=CW62F6BP4SGUBJSGMJIEB2GALUYBG4ADCMMXDFK5T36WADD3HMLQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.306047339 (61h47m47.265144586s) [noise=true , address=104.36.82.61:4387 , piece_id=N4VKGWLIZLZ5YEJY5NGTSDTDJ3F7K445SR4E7HPEO4JBLNPBVZJQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.306780679 (61h47m47.265877925s) [noise=true , address=104.36.82.34:4570 , piece_id=L6SHQIS3MAFED2ZXGCIESIPAHYQFZZYZ7N2GXROUVA2D5YA4C7WQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.307357189 (61h47m47.266454435s) [noise=true , address=104.36.82.52:4117 , piece_id=O6BLM7HUE6LGNJEAS7F3KYYQHCMRH7NGOSYNJST3G4C6ENTRC6PQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.307541549 (61h47m47.266638794s) [noise=true , address=104.36.82.39:4735 , piece_id=KOM4JXXCYCXXRLDAR3AUGLJK2TIP777VDTQYTIGGSTPGK5T2GSOQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308048479 (61h47m47.267145728s) [noise=true , address=64.49.13.140:4516 , piece_id=6VK4IWDT5ZZFTNDLULF5OYMGYDE35BASS47H3KUD535I6HRZMYPQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308417525 (61h47m47.267514777s) [noise=true , address=45.91.116.5:4319 , piece_id=JBTG6OWMF7IW2ZO4WFLZNNOWX2ZBXIEOJJE4ZAAN45KLMNJL7BKQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.308858400 (61h47m47.267955685s) [noise=true , address=104.36.82.37:4678 , piece_id=SFVTDFFR3QYMFBIV5L36NPPVJ4LU3VSKXOZ6W7VKM4QY3H2J5C3Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.309308853 (61h47m47.268406109s) [noise=true , address=104.36.82.60:4361 , piece_id=EXMTV7NEXUYFNYWYH273D356L3TL6G2KWRYNA6CE3KEVMPCVPOMA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.309746358 (61h47m47.268843613s) [noise=true , address=104.36.82.38:4707 , piece_id=PTXX6JYDMYD7RNCNMLMC3JVU24QKB56MQZV3MRG5JFWOYIUL3HZA, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310147073 (61h47m47.269244321s) [noise=true , address=104.36.82.62:4430 , piece_id=JCI7BNKY3NFLKD63QMR6T3QBPSUFTHGGJUCTBZNEVUZIXT35WTUQ, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310472601 (61h47m47.269569846s) [noise=true , address=104.36.82.59:4319 , piece_id=YVIQPYHE3MN5KFJLSQKUWA6RKLFLC3VXDSH7XTNXT77EW3XKNV2A, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.310803180 (61h47m47.269900449s) [noise=true , address=104.36.82.46:4511 , piece_id=Z5DTRZLZ3A2MXQJN5PA3JNYEESWS46T57T3U5H2GNOB6HYE2TK3Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.311365894 (61h47m47.270463132s) [noise=true , address=104.36.82.38:4724 , piece_id=C4KN7734QM4FL63NNQZCXZ5GWQIWK25OZEJPMETKXYI4BV6HPU7Q, seg_pos={0 0}, upload=64362]: Uploading piece...
Aug 11 07:13:25.879874489 (61h47m47.838971734s) [upload=64362]: Next returned nil segment
Aug 11 07:13:25.879908578 (61h47m47.839005822s) [upload=64362]: Waiting for error group managing segments...
Aug 11 07:13:26.032633304 (61h47m47.991730538s) [noise=true , address=104.36.82.37:4678 , piece_id=SFVTDFFR3QYMFBIV5L36NPPVJ4LU3VSKXOZ6W7VKM4QY3H2J5C3Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.036252942 (61h47m47.995350188s) [noise=true , address=104.36.82.38:4724 , piece_id=C4KN7734QM4FL63NNQZCXZ5GWQIWK25OZEJPMETKXYI4BV6HPU7Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.037695400 (61h47m47.996792638s) [noise=true , address=104.36.82.39:4735 , piece_id=KOM4JXXCYCXXRLDAR3AUGLJK2TIP777VDTQYTIGGSTPGK5T2GSOQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.038637828 (61h47m47.997735068s) [noise=true , address=104.36.82.61:4387 , piece_id=N4VKGWLIZLZ5YEJY5NGTSDTDJ3F7K445SR4E7HPEO4JBLNPBVZJQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.045893664 (61h47m48.004990909s) [noise=true , address=45.91.116.5:4319 , piece_id=JBTG6OWMF7IW2ZO4WFLZNNOWX2ZBXIEOJJE4ZAAN45KLMNJL7BKQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.047276255 (61h47m48.0063735s) [noise=true , address=104.36.82.62:4430 , piece_id=JCI7BNKY3NFLKD63QMR6T3QBPSUFTHGGJUCTBZNEVUZIXT35WTUQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.047377178 (61h47m48.006474412s) [noise=true , address=104.36.82.8:4984 , piece_id=H7I45XI3C4ZD5DMFECNB666RKPMBWV7JA7OCYDYZZ5TFHPK4MCXA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.051860078 (61h47m48.010957327s) [noise=true , address=104.36.82.19:4434 , piece_id=VH6ND4EPW5ERAMN7JX4TSVRI2FLKDFC7WRJLRNJBUSLIQF6MN7ZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.052252913 (61h47m48.011350149s) [noise=true , address=104.36.82.34:4570 , piece_id=L6SHQIS3MAFED2ZXGCIESIPAHYQFZZYZ7N2GXROUVA2D5YA4C7WQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.052631036 (61h47m48.011728284s) [noise=true , address=104.36.82.59:4319 , piece_id=YVIQPYHE3MN5KFJLSQKUWA6RKLFLC3VXDSH7XTNXT77EW3XKNV2A, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.053007186 (61h47m48.012104425s) [noise=true , address=104.36.82.38:4707 , piece_id=PTXX6JYDMYD7RNCNMLMC3JVU24QKB56MQZV3MRG5JFWOYIUL3HZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.054063000 (61h47m48.013160243s) [noise=true , address=104.36.82.47:4522 , piece_id=25UJWGO2K3FBYMTEWCW5SPA7VC5CMQX54D3FRJYKDBGSTH3RSDBQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059265640 (61h47m48.018362878s) [noise=true , address=104.36.82.46:4511 , piece_id=Z5DTRZLZ3A2MXQJN5PA3JNYEESWS46T57T3U5H2GNOB6HYE2TK3Q, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059317136 (61h47m48.018414381s) [noise=true , address=104.36.82.60:4361 , piece_id=EXMTV7NEXUYFNYWYH273D356L3TL6G2KWRYNA6CE3KEVMPCVPOMA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: <nil>
Aug 11 07:13:26.059323724 (61h47m48.018420963s) [seg_pos={0 0}, upload=64362]: Segment reached optimal threshold of 14 pieces.
Aug 11 07:13:26.059465171 (61h47m48.018562409s) [noise=true , address=104.36.82.52:4117 , piece_id=O6BLM7HUE6LGNJEAS7F3KYYQHCMRH7NGOSYNJST3G4C6ENTRC6PQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QVEhFpjfLubGsZmoY1XQdDWevLy2xWdjtPq4JnbSYuBgEXgz7): protocol: expected piece hash; context canceled; EOF
Aug 11 07:13:26.059577068 (61h47m48.018674304s) [noise=true , address=64.49.13.140:4516 , piece_id=6VK4IWDT5ZZFTNDLULF5OYMGYDE35BASS47H3KUD535I6HRZMYPQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->64.49.13.140:4516: use of closed network connection
Aug 11 07:13:26.059662131 (61h47m48.018759369s) [noise=true , address=193.149.164.143:4695 , piece_id=ALHXDSMWAC6TORJ27XGQMYS2GKSFACH2J2FYVVEPKQQQIVH34RZA, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TZfgz24gnZr4UryzEKw6gu94njnmCvafX5X64MKFSJqaUWSVh): protocol: write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection; write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47376->193.149.164.143:4695: use of closed network connection
Aug 11 07:13:26.059669068 (61h47m48.018766314s) [noise=true , address=64.49.13.155:4914 , piece_id=CW62F6BP4SGUBJSGMJIEB2GALUYBG4ADCMMXDFK5T36WADD3HMLQ, seg_pos={0 0}, upload=64362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection; write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42774->64.49.13.155:4914: use of closed network connection
Aug 11 07:13:26.059702626 (61h47m48.018799877s) [seg_pos={0 0}, upload=64362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 07:13:26.059813221 (61h47m48.018910468s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 07:13:26.059820171 (61h47m48.018917417s) [upload=64362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 07:13:26.209063727 (61h47m48.168160975s) [upload=64362]: Done uploading segments...
Aug 11 07:13:26.209083076 (61h47m48.16818031s) [upload=64362]: Upload finished. err: <nil>
Duration: 1.623923588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X............X.X..........XX........................] duration:
816.721637ms
FAIL (2025-08-11 07:13:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 816.753642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X.....X.........................................] duration:
2.443933116s
FAIL (2025-08-11 07:12:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after eaff972616b75862e92acd40c10b2d5a07daf5b1e00a3b4059f35920f8221be3 != before 85f088298ca05b5556f091a8005234bf30db40fc04037320fb234eb408096447
======LOGS======
Aug 11 06:39:59.725848306 (61h14m21.684945551s) [upload=63762]: Starting upload
Aug 11 06:39:59.725931815 (61h14m21.685029061s) [upload=63762]: Done starting upload
Aug 11 06:39:59.726072508 (61h14m21.685169742s) [upload=63762]: Uploading segments...
Aug 11 06:39:59.726419038 (61h14m21.685516306s) [upload=63762]: Got next segment. Inline: false
Aug 11 06:39:59.726513974 (61h14m21.685611219s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:39:59.726520151 (61h14m21.685617396s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:39:59.921599638 (61h14m21.880696893s) [seg_pos={0 0}, upload=63762]: Begin upload segment...
Aug 11 06:39:59.921681619 (61h14m21.880778869s) [seg_pos={0 0}, upload=63762]: Done begin upload segment.
Aug 11 06:39:59.921740781 (61h14m21.880838027s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922270828 (61h14m21.881368083s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922315855 (61h14m21.881413107s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922875727 (61h14m21.88197298s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922920301 (61h14m21.882017557s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923290075 (61h14m21.882387329s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923361488 (61h14m21.882458745s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923694242 (61h14m21.88279149s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923800406 (61h14m21.882897643s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924061141 (61h14m21.883158395s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924223704 (61h14m21.883320957s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924402284 (61h14m21.883499536s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924649472 (61h14m21.883746724s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924754018 (61h14m21.883851273s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925097825 (61h14m21.884195074s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925114104 (61h14m21.88421136s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925514363 (61h14m21.884611618s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925890080 (61h14m21.884987334s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:40:00.469098718 (61h14m22.428195964s) [upload=63762]: Next returned nil segment
Aug 11 06:40:00.469119935 (61h14m22.428217187s) [upload=63762]: Waiting for error group managing segments...
Aug 11 06:40:00.629398631 (61h14m22.588495869s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.639603278 (61h14m22.598700519s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662617451 (61h14m22.621714686s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662995050 (61h14m22.622092286s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.663348363 (61h14m22.622445596s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664183468 (61h14m22.623280706s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664681699 (61h14m22.623778933s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666358319 (61h14m22.625455568s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666773748 (61h14m22.625870983s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.674265557 (61h14m22.633362789s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676300370 (61h14m22.635397601s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676376615 (61h14m22.635473853s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683726940 (61h14m22.642824176s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683775996 (61h14m22.642873232s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683792097 (61h14m22.642889336s) [seg_pos={0 0}, upload=63762]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:40:00.683938979 (61h14m22.643036219s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129sUhRR5RYtmrrfcEq2KgikZqZqQMRbwgK8NAKLFTTZgXDHW1v): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.683996093 (61h14m22.643093341s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684005924 (61h14m22.643103163s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684100161 (61h14m22.643197407s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kuxXNRsBsP6izniQ2AcT4DJRW2RYWdJurSPYh5h8TF32pwzza): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684125888 (61h14m22.643223147s) [seg_pos={0 0}, upload=63762]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:40:00.684256856 (61h14m22.643354092s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:40:00.684263251 (61h14m22.643360496s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:40:00.835290443 (61h14m22.794387754s) [upload=63762]: Done uploading segments...
Aug 11 06:40:00.835334006 (61h14m22.794431279s) [upload=63762]: Upload finished. err: <nil>
Duration: 2.443990293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X............X.X..........XX.......................] duration:
800.993912ms
FAIL (2025-08-11 07:12:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 801.045441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X............X.X..........XX......................] duration:
842.733311ms
FAIL (2025-08-11 07:12:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 842.770259ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X............X.X..........XX.....................] duration:
821.66563ms
FAIL (2025-08-11 07:11:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 821.694072ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X............X.X..........XX....................] duration:
936.222045ms
FAIL (2025-08-11 07:11:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 936.256328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X.....X........................................] duration:
2.30411625s
FAIL (2025-08-11 07:11:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after eaff972616b75862e92acd40c10b2d5a07daf5b1e00a3b4059f35920f8221be3 != before 85f088298ca05b5556f091a8005234bf30db40fc04037320fb234eb408096447
======LOGS======
Aug 11 06:39:59.725848306 (61h14m21.684945551s) [upload=63762]: Starting upload
Aug 11 06:39:59.725931815 (61h14m21.685029061s) [upload=63762]: Done starting upload
Aug 11 06:39:59.726072508 (61h14m21.685169742s) [upload=63762]: Uploading segments...
Aug 11 06:39:59.726419038 (61h14m21.685516306s) [upload=63762]: Got next segment. Inline: false
Aug 11 06:39:59.726513974 (61h14m21.685611219s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:39:59.726520151 (61h14m21.685617396s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:39:59.921599638 (61h14m21.880696893s) [seg_pos={0 0}, upload=63762]: Begin upload segment...
Aug 11 06:39:59.921681619 (61h14m21.880778869s) [seg_pos={0 0}, upload=63762]: Done begin upload segment.
Aug 11 06:39:59.921740781 (61h14m21.880838027s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922270828 (61h14m21.881368083s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922315855 (61h14m21.881413107s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922875727 (61h14m21.88197298s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922920301 (61h14m21.882017557s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923290075 (61h14m21.882387329s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923361488 (61h14m21.882458745s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923694242 (61h14m21.88279149s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923800406 (61h14m21.882897643s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924061141 (61h14m21.883158395s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924223704 (61h14m21.883320957s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924402284 (61h14m21.883499536s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924649472 (61h14m21.883746724s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924754018 (61h14m21.883851273s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925097825 (61h14m21.884195074s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925114104 (61h14m21.88421136s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925514363 (61h14m21.884611618s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925890080 (61h14m21.884987334s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:40:00.469098718 (61h14m22.428195964s) [upload=63762]: Next returned nil segment
Aug 11 06:40:00.469119935 (61h14m22.428217187s) [upload=63762]: Waiting for error group managing segments...
Aug 11 06:40:00.629398631 (61h14m22.588495869s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.639603278 (61h14m22.598700519s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662617451 (61h14m22.621714686s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662995050 (61h14m22.622092286s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.663348363 (61h14m22.622445596s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664183468 (61h14m22.623280706s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664681699 (61h14m22.623778933s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666358319 (61h14m22.625455568s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666773748 (61h14m22.625870983s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.674265557 (61h14m22.633362789s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676300370 (61h14m22.635397601s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676376615 (61h14m22.635473853s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683726940 (61h14m22.642824176s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683775996 (61h14m22.642873232s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683792097 (61h14m22.642889336s) [seg_pos={0 0}, upload=63762]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:40:00.683938979 (61h14m22.643036219s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129sUhRR5RYtmrrfcEq2KgikZqZqQMRbwgK8NAKLFTTZgXDHW1v): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.683996093 (61h14m22.643093341s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684005924 (61h14m22.643103163s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684100161 (61h14m22.643197407s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kuxXNRsBsP6izniQ2AcT4DJRW2RYWdJurSPYh5h8TF32pwzza): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684125888 (61h14m22.643223147s) [seg_pos={0 0}, upload=63762]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:40:00.684256856 (61h14m22.643354092s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:40:00.684263251 (61h14m22.643360496s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:40:00.835290443 (61h14m22.794387754s) [upload=63762]: Done uploading segments...
Aug 11 06:40:00.835334006 (61h14m22.794431279s) [upload=63762]: Upload finished. err: <nil>
Duration: 2.304146297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X............X.X..........XX...................] duration:
839.071405ms
FAIL (2025-08-11 07:11:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 839.101436ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X............X.X..........XX..................] duration:
944.861973ms
FAIL (2025-08-11 07:10:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 944.890294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X.....X.......................................] duration:
2.418610101s
FAIL (2025-08-11 07:10:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after eaff972616b75862e92acd40c10b2d5a07daf5b1e00a3b4059f35920f8221be3 != before 85f088298ca05b5556f091a8005234bf30db40fc04037320fb234eb408096447
======LOGS======
Aug 11 06:39:59.725848306 (61h14m21.684945551s) [upload=63762]: Starting upload
Aug 11 06:39:59.725931815 (61h14m21.685029061s) [upload=63762]: Done starting upload
Aug 11 06:39:59.726072508 (61h14m21.685169742s) [upload=63762]: Uploading segments...
Aug 11 06:39:59.726419038 (61h14m21.685516306s) [upload=63762]: Got next segment. Inline: false
Aug 11 06:39:59.726513974 (61h14m21.685611219s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:39:59.726520151 (61h14m21.685617396s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:39:59.921599638 (61h14m21.880696893s) [seg_pos={0 0}, upload=63762]: Begin upload segment...
Aug 11 06:39:59.921681619 (61h14m21.880778869s) [seg_pos={0 0}, upload=63762]: Done begin upload segment.
Aug 11 06:39:59.921740781 (61h14m21.880838027s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922270828 (61h14m21.881368083s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922315855 (61h14m21.881413107s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922875727 (61h14m21.88197298s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922920301 (61h14m21.882017557s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923290075 (61h14m21.882387329s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923361488 (61h14m21.882458745s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923694242 (61h14m21.88279149s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923800406 (61h14m21.882897643s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924061141 (61h14m21.883158395s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924223704 (61h14m21.883320957s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924402284 (61h14m21.883499536s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924649472 (61h14m21.883746724s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924754018 (61h14m21.883851273s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925097825 (61h14m21.884195074s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925114104 (61h14m21.88421136s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925514363 (61h14m21.884611618s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925890080 (61h14m21.884987334s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:40:00.469098718 (61h14m22.428195964s) [upload=63762]: Next returned nil segment
Aug 11 06:40:00.469119935 (61h14m22.428217187s) [upload=63762]: Waiting for error group managing segments...
Aug 11 06:40:00.629398631 (61h14m22.588495869s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.639603278 (61h14m22.598700519s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662617451 (61h14m22.621714686s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662995050 (61h14m22.622092286s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.663348363 (61h14m22.622445596s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664183468 (61h14m22.623280706s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664681699 (61h14m22.623778933s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666358319 (61h14m22.625455568s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666773748 (61h14m22.625870983s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.674265557 (61h14m22.633362789s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676300370 (61h14m22.635397601s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676376615 (61h14m22.635473853s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683726940 (61h14m22.642824176s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683775996 (61h14m22.642873232s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683792097 (61h14m22.642889336s) [seg_pos={0 0}, upload=63762]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:40:00.683938979 (61h14m22.643036219s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129sUhRR5RYtmrrfcEq2KgikZqZqQMRbwgK8NAKLFTTZgXDHW1v): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.683996093 (61h14m22.643093341s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684005924 (61h14m22.643103163s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684100161 (61h14m22.643197407s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kuxXNRsBsP6izniQ2AcT4DJRW2RYWdJurSPYh5h8TF32pwzza): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684125888 (61h14m22.643223147s) [seg_pos={0 0}, upload=63762]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:40:00.684256856 (61h14m22.643354092s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:40:00.684263251 (61h14m22.643360496s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:40:00.835290443 (61h14m22.794387754s) [upload=63762]: Done uploading segments...
Aug 11 06:40:00.835334006 (61h14m22.794431279s) [upload=63762]: Upload finished. err: <nil>
Duration: 2.418647405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X............X.X..........XX.................] duration:
1.011150753s
FAIL (2025-08-11 07:09:30 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 06:58:31.860234092 (61h32m53.819331338s) [upload=64092]: Starting upload Aug 11 06:58:31.860299957 (61h32m53.819397205s) [upload=64092]: Done starting upload Aug 11 06:58:31.860422179 (61h32m53.819519424s) [upload=64092]: Uploading segments... Aug 11 06:58:31.860459822 (61h32m53.819557077s) [upload=64092]: Got next segment. Inline: true Aug 11 06:58:31.860464385 (61h32m53.819561631s) [upload=64092]: Waiting for error group managing segments... Aug 11 06:58:31.860519860 (61h32m53.819617105s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:58:31.860524277 (61h32m53.819621522s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:58:31.860527220 (61h32m53.819624465s) [upload=64092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:58:32.024834115 (61h32m53.983931362s) [upload=64092]: Done uploading segments... Aug 11 06:58:32.024861833 (61h32m53.98395908s) [upload=64092]: Upload finished. err: <nil>
Duration: 1.01118441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X.....X......................................] duration:
2.339233241s
FAIL (2025-08-11 07:09:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after eaff972616b75862e92acd40c10b2d5a07daf5b1e00a3b4059f35920f8221be3 != before 85f088298ca05b5556f091a8005234bf30db40fc04037320fb234eb408096447
======LOGS======
Aug 11 06:39:59.725848306 (61h14m21.684945551s) [upload=63762]: Starting upload
Aug 11 06:39:59.725931815 (61h14m21.685029061s) [upload=63762]: Done starting upload
Aug 11 06:39:59.726072508 (61h14m21.685169742s) [upload=63762]: Uploading segments...
Aug 11 06:39:59.726419038 (61h14m21.685516306s) [upload=63762]: Got next segment. Inline: false
Aug 11 06:39:59.726513974 (61h14m21.685611219s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:39:59.726520151 (61h14m21.685617396s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:39:59.921599638 (61h14m21.880696893s) [seg_pos={0 0}, upload=63762]: Begin upload segment...
Aug 11 06:39:59.921681619 (61h14m21.880778869s) [seg_pos={0 0}, upload=63762]: Done begin upload segment.
Aug 11 06:39:59.921740781 (61h14m21.880838027s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922270828 (61h14m21.881368083s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922315855 (61h14m21.881413107s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922875727 (61h14m21.88197298s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.922920301 (61h14m21.882017557s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923290075 (61h14m21.882387329s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923361488 (61h14m21.882458745s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923694242 (61h14m21.88279149s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.923800406 (61h14m21.882897643s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924061141 (61h14m21.883158395s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924223704 (61h14m21.883320957s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924402284 (61h14m21.883499536s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924649472 (61h14m21.883746724s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.924754018 (61h14m21.883851273s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925097825 (61h14m21.884195074s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925114104 (61h14m21.88421136s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925514363 (61h14m21.884611618s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:39:59.925890080 (61h14m21.884987334s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Uploading piece...
Aug 11 06:40:00.469098718 (61h14m22.428195964s) [upload=63762]: Next returned nil segment
Aug 11 06:40:00.469119935 (61h14m22.428217187s) [upload=63762]: Waiting for error group managing segments...
Aug 11 06:40:00.629398631 (61h14m22.588495869s) [noise=true , address=77.90.31.16:4741 , piece_id=E6I443BF6HVAI4UQMCUO27TBGGRMMMADCZXQXDJE2QJVAT5BFJFA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.639603278 (61h14m22.598700519s) [noise=true , address=77.90.31.14:4672 , piece_id=SR7IUK2KOU3JUMNCWMNQEMVRJUEFGKL4MHKFTCNY7G5L2WTYHJGA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662617451 (61h14m22.621714686s) [noise=true , address=104.36.82.35:4605 , piece_id=BRLAL4ZYYRFFURWLATKC64QMOMB6BP5MEOAW6FJ5E3B32P2CMWJQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.662995050 (61h14m22.622092286s) [noise=true , address=104.36.82.5:4844 , piece_id=MD6IW2RUR6PCNDM6GHXLBTEWAGINR2DQULAANSLZR7P24RAHIZEQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.663348363 (61h14m22.622445596s) [noise=true , address=104.36.82.22:4532 , piece_id=AC4VOG225MQFEIXV7DABJFFMAXGFM5LNEWWNXUJVIDV5NWQQGDCA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664183468 (61h14m22.623280706s) [noise=true , address=104.36.82.20:4463 , piece_id=5VM6BQBNQ4IOZRVUSJFZRRDPLUYE32264CRQUFFTP6E4LHU4FA5Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.664681699 (61h14m22.623778933s) [noise=true , address=104.36.82.9:4036 , piece_id=BR6JXCYZKQRIHBKOHJJZP3NZ6QVXR6XCVO6CHVWQGFC6NUADWWOQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666358319 (61h14m22.625455568s) [noise=true , address=77.90.31.11:4558 , piece_id=KTTYY4CZFYWS4FZNCJ4EADNEEH4JLXDSPVWIR7DVXBXLC2GC7SBQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.666773748 (61h14m22.625870983s) [noise=true , address=104.36.82.45:4907 , piece_id=3VTWKI6XZYSEDBE7QRNMSYGOSGXNKJP2IRNN7CLDSEC3BIX626OQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.674265557 (61h14m22.633362789s) [noise=true , address=104.36.82.23:4452 , piece_id=WNCA2UGPF4YXZHYUVJQ7EFQZJZAWYUVHONGOFPJKC37FPO4XT7QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676300370 (61h14m22.635397601s) [noise=true , address=104.36.82.37:4656 , piece_id=KE2J7NTI66JFEYM5PIODEX4SJSDIW75QTCEMYBKPHUGXQRWCBS6A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.676376615 (61h14m22.635473853s) [noise=true , address=104.36.82.39:4733 , piece_id=VTRWN5YXDCMESMUW7YZXNHFACPHB4IBEUN4XYR66O7VCAWGP5TMQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683726940 (61h14m22.642824176s) [noise=true , address=104.36.82.21:4494 , piece_id=72CKENWA4YLXMED7SZ5AEHG7KVUMMUVIDKS7RQNTMXNI7M75YAZQ, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683775996 (61h14m22.642873232s) [noise=true , address=104.36.82.62:4419 , piece_id=OYZPOFX6ER6WW4VYEHSNID4A6YWWNERGWTKAXE2KKPN46WRQRZ4Q, seg_pos={0 0}, upload=63762]: Done uploading piece. err: <nil>
Aug 11 06:40:00.683792097 (61h14m22.642889336s) [seg_pos={0 0}, upload=63762]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:40:00.683938979 (61h14m22.643036219s) [noise=true , address=104.36.82.62:4415 , piece_id=A4PQTCMCU46GMEIJJL7ZXMD7TKVQAOQRPSVDSAHS2NQBLSG5544A, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129sUhRR5RYtmrrfcEq2KgikZqZqQMRbwgK8NAKLFTTZgXDHW1v): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.683996093 (61h14m22.643093341s) [noise=true , address=104.36.82.60:4355 , piece_id=3ECMWYIGYNWAUL4XNQAUIKDRUC63YJ62EXLIZFEU6ES3WVIQF6QA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684005924 (61h14m22.643103163s) [noise=true , address=104.36.82.59:4307 , piece_id=YQ4CC5GBYXOXAA55NAWB3ZFCTJVHBSYHHAMOQJFW7PD7VSHOOUWA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684100161 (61h14m22.643197407s) [noise=true , address=104.36.82.17:4346 , piece_id=NGLAA5ZEIRFO2DHD3X2DA56O3TACKKFNTX4GUVAPHNS77TNHKXIA, seg_pos={0 0}, upload=63762]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kuxXNRsBsP6izniQ2AcT4DJRW2RYWdJurSPYh5h8TF32pwzza): protocol: expected piece hash; context canceled; EOF
Aug 11 06:40:00.684125888 (61h14m22.643223147s) [seg_pos={0 0}, upload=63762]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:40:00.684256856 (61h14m22.643354092s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:40:00.684263251 (61h14m22.643360496s) [upload=63762]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:40:00.835290443 (61h14m22.794387754s) [upload=63762]: Done uploading segments...
Aug 11 06:40:00.835334006 (61h14m22.794431279s) [upload=63762]: Upload finished. err: <nil>
Duration: 2.339261864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|