Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X...........................................X...............] duration:
820.767346ms
FAIL (2025-08-15 09:43:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.806293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X...........................................X..............] duration:
878.438285ms
FAIL (2025-08-15 09:43:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 878.477179ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.336493942s
FAIL (2025-08-15 09:42:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.336537321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X...........................................X.............] duration:
822.313475ms
FAIL (2025-08-15 09:42:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.346864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.353148674s
FAIL (2025-08-15 09:42:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.353202663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...........................................X............] duration:
831.739082ms
FAIL (2025-08-15 09:41:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.788792ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.625943267s
FAIL (2025-08-15 09:41:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.625974853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.309500182s
FAIL (2025-08-15 09:40:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.309557259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...........................................X...........] duration:
821.420424ms
FAIL (2025-08-15 09:40:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.451795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...........................................X..........] duration:
805.060887ms
FAIL (2025-08-15 09:40:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 805.098994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.408948456s
FAIL (2025-08-15 09:39:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.408978429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...........................................X.........] duration:
832.348028ms
FAIL (2025-08-15 09:39:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.394098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.407103088s
FAIL (2025-08-15 09:38:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.4072272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...........................................X........] duration:
829.709663ms
FAIL (2025-08-15 09:38:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.73833ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.476894597s
FAIL (2025-08-15 09:38:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.476928403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.346517038s
FAIL (2025-08-15 09:37:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.346552751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...........................................X.......] duration:
963.918753ms
FAIL (2025-08-15 09:37:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.954156ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.463364576s
FAIL (2025-08-15 09:37:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.463477839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...........................................X......] duration:
813.469915ms
FAIL (2025-08-15 09:36:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.50204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...........................................X.....] duration:
878.870592ms
FAIL (2025-08-15 09:36:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 878.903956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.368754176s
FAIL (2025-08-15 09:35:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.368783608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...........................................X....] duration:
980.485731ms
FAIL (2025-08-15 09:35:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 980.518721ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.638159036s
FAIL (2025-08-15 09:35:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.638197575s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X...........................................X...] duration:
888.233929ms
FAIL (2025-08-15 09:34:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.267849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.455739918s
FAIL (2025-08-15 09:34:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.455766183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.473564784s
FAIL (2025-08-15 09:34:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.473675977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.50454782s
FAIL (2025-08-15 09:33:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.504575901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X...........................................X..] duration:
834.681647ms
FAIL (2025-08-15 09:33:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.706565ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.457500573s
FAIL (2025-08-15 09:33:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.457534116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...........................................X.] duration:
892.569992ms
FAIL (2025-08-15 09:32:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.606151ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.433092403s
FAIL (2025-08-15 09:32:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ead900ba2976c31725f34eaf1ac037cacfb191805dab2e66cb897281292c7263 != before 092dfc386aff5e587451dd1a18d40304102da7292ebfdc55cf359c800cf2de75
======LOGS======
Aug 15 09:32:13.197873317 (160h6m35.156970556s) [upload=166779]: Starting upload
Aug 15 09:32:13.197968158 (160h6m35.157065403s) [upload=166779]: Done starting upload
Aug 15 09:32:13.198136294 (160h6m35.157233531s) [upload=166779]: Uploading segments...
Aug 15 09:32:13.198330643 (160h6m35.157427889s) [upload=166779]: Got next segment. Inline: false
Aug 15 09:32:13.198443958 (160h6m35.157541204s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 09:32:13.198457706 (160h6m35.157554954s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 09:32:13.400188729 (160h6m35.359285979s) [seg_pos={0 0}, upload=166779]: Begin upload segment...
Aug 15 09:32:13.400262546 (160h6m35.359359779s) [seg_pos={0 0}, upload=166779]: Done begin upload segment.
Aug 15 09:32:13.400309908 (160h6m35.359407153s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400339238 (160h6m35.359436492s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400842849 (160h6m35.359940106s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.400897753 (160h6m35.359995008s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401274934 (160h6m35.360372186s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401287540 (160h6m35.360384795s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401633640 (160h6m35.360730898s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.401726389 (160h6m35.360823644s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402084791 (160h6m35.361182045s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.402202751 (160h6m35.361300007s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.403263202 (160h6m35.362360447s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404620229 (160h6m35.363717484s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.404843842 (160h6m35.363941087s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.405733384 (160h6m35.36483063s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.406072216 (160h6m35.365169454s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.409314108 (160h6m35.368411407s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.411932322 (160h6m35.371029565s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.413886724 (160h6m35.372983967s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Uploading piece...
Aug 15 09:32:13.955937301 (160h6m35.915034559s) [upload=166779]: Next returned nil segment
Aug 15 09:32:13.955958144 (160h6m35.915055394s) [upload=166779]: Waiting for error group managing segments...
Aug 15 09:32:14.125546124 (160h6m36.084643363s) [noise=true , address=77.90.31.15:4701 , piece_id=44XMN6JJFGNWUDBVZOJQ4B43G4OWBH4FGDPUOG5SYPMAQN6GNUKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.131550593 (160h6m36.090647824s) [noise=true , address=77.90.31.21:4912 , piece_id=JML2SOGYTL4LM4AHNBCZWVJXKWPC4WKH6XGO6MLFUL3A3FNQ7G3A, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.147894809 (160h6m36.106992048s) [noise=true , address=104.36.82.39:4747 , piece_id=QJLOWQRQQSSPAW4KUARY6RDXS56JOQVO4SF3B7QXBHR5A5ADTS7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.148941406 (160h6m36.108038644s) [noise=true , address=104.36.82.39:4734 , piece_id=HFPUOYWE5VUNWC7DMZZE45BQ5FUZJJVYCVDRKIUXN363X7AB2CAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.150169788 (160h6m36.109267027s) [noise=true , address=77.90.31.11:4575 , piece_id=OZSZXAONEY3KYDJG52GUDLO63HHTKMGCMICADZXPIAWFIL72R7JA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.154408686 (160h6m36.113505925s) [noise=true , address=104.36.82.17:4341 , piece_id=BLHSL7IDYWL5XO2L23B5GQZ7SMUUEA6TD7P56KSMNZ46QNIKFQZA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.166911450 (160h6m36.126008689s) [noise=true , address=104.36.82.58:4281 , piece_id=LBHA5AALLNKTOBVOVGA4KYEWXWXNKXBS67K6I22QEZOV4O24YTWQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.169567791 (160h6m36.128665029s) [noise=true , address=104.36.82.9:4025 , piece_id=R7Z4GEKIAVTZEV5TBE7ZPEZXSLXHVQYIUU5A6OHTATCOBN5CGADA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.173882489 (160h6m36.132979727s) [noise=true , address=104.36.82.19:4411 , piece_id=YQNP6JGOAPYJFIZUT7LR5OKTUGQRSQ4LTNSZVYOGGBEIKU6QXLLQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.181791500 (160h6m36.140888749s) [noise=true , address=104.36.82.5:4846 , piece_id=SXM2DGD44NLCNGNQTX5WFGNCBVQBQTAHWKDVU2BBYKJRKDJPABEQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.229384126 (160h6m36.188481359s) [noise=true , address=77.90.31.12:4594 , piece_id=YEYTOWY4K7CJCHGFJ46NNAOJ3BRO3XB3CT55H44O5SC675CI2HSA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.241665189 (160h6m36.200762428s) [noise=true , address=104.36.82.37:4664 , piece_id=TMWIKU4TFCWGLC7JSSYOJ7D4O7MYHF4FNJYEYF4HY7PMYOBGIBNA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.261304382 (160h6m36.220401618s) [noise=true , address=79.127.219.48:4084 , piece_id=O3OXQJQ3DFUOXMVSMING43PBUXMLLAT7TEZTDFWQHQI3FV7I6JVA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294439033 (160h6m36.253536265s) [noise=true , address=104.36.82.44:4880 , piece_id=WJ5GI5KGTJMQNT2EKS5XAUJ7CU6O2GOJRUPWHU2KO5MBX23NWXCA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: <nil>
Aug 15 09:32:14.294459234 (160h6m36.253556466s) [seg_pos={0 0}, upload=166779]: Segment reached optimal threshold of 14 pieces.
Aug 15 09:32:14.294609561 (160h6m36.253706806s) [noise=true , address=79.127.220.101:4071 , piece_id=LORVCGZ2OCJEXCKNS64KESR44MXGRYLP2JRUZKU7MPD5VDPAIMAQ, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UW4p7c1bwrzjUQ5bXZuDq3TtK3ra1riJe5DmUmUZiTuMhMVAX): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294722213 (160h6m36.253819459s) [noise=true , address=79.127.201.215:4347 , piece_id=4DH6MAAITGNZABD4HDUGFBLHJ3SSCJ7DB5QCIZ2MBMS5GWNUXOWA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294741016 (160h6m36.253838249s) [noise=true , address=104.36.82.59:4318 , piece_id=D4RAJ33FGUK4VTFWZ2MNEA4DNEOPHNQNBA3F4MXXWCGG4RSI2FKA, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 15 09:32:14.294825538 (160h6m36.253922769s) [noise=true , address=66.23.193.175:4555 , piece_id=2YBFH4KGFZOCOUFX6VCJYD7RJW4U44FNRCNMOCT7BU4WBHEILV7Q, seg_pos={0 0}, upload=166779]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40838->66.23.193.175:4555: use of closed network connection
Aug 15 09:32:14.294835586 (160h6m36.253932818s) [seg_pos={0 0}, upload=166779]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 09:32:14.294908607 (160h6m36.254005838s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 09:32:14.294912456 (160h6m36.254009686s) [upload=166779]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 09:32:14.435434547 (160h6m36.394531782s) [upload=166779]: Done uploading segments...
Aug 15 09:32:14.435455846 (160h6m36.394553085s) [upload=166779]: Upload finished. err: <nil>
Duration: 2.433128544s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X...........................................X] duration:
365.280821ms
FAIL (2025-08-15 09:32:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 09:32:15.737718013 (160h6m37.696815245s) [upload=166781]: Starting upload Aug 15 09:32:15.737786996 (160h6m37.696884245s) [upload=166781]: Done starting upload Aug 15 09:32:15.737869154 (160h6m37.6969664s) [upload=166781]: Uploading segments... Aug 15 09:32:15.737948756 (160h6m37.697046003s) [upload=166781]: Got next segment. Inline: true Aug 15 09:32:15.737954680 (160h6m37.697051928s) [upload=166781]: Waiting for error group managing segments... Aug 15 09:32:15.738001990 (160h6m37.697099242s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 09:32:15.738006883 (160h6m37.697104129s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 09:32:15.738012083 (160h6m37.69710933s) [upload=166781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 09:32:15.826771454 (160h6m37.7858687s) [upload=166781]: Done uploading segments... Aug 15 09:32:15.826789738 (160h6m37.785886975s) [upload=166781]: Upload finished. err: metaclient: Too Many Requests
Duration: 365.308226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
854.860333ms
FAIL (2025-08-15 09:31:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.895864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
843.030558ms
FAIL (2025-08-15 09:31:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.067014ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
835.697826ms
FAIL (2025-08-15 09:29:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.727637ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
972.51837ms
FAIL (2025-08-15 09:29:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 972.564621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
831.995677ms
FAIL (2025-08-15 09:27:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.027717ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
830.841284ms
FAIL (2025-08-15 09:27:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.888433ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
835.230348ms
FAIL (2025-08-15 09:26:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.259617ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
867.200926ms
FAIL (2025-08-15 09:26:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.237194ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
857.77402ms
FAIL (2025-08-15 09:25:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.809177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
858.265305ms
FAIL (2025-08-15 09:24:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.296182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
808.100892ms
FAIL (2025-08-15 09:23:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 808.201593ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
898.325317ms
FAIL (2025-08-15 09:22:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 898.360199ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
876.306701ms
FAIL (2025-08-15 09:22:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.343275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
822.681183ms
FAIL (2025-08-15 09:21:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.707935ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
836.445871ms
FAIL (2025-08-15 09:20:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.497438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
992.394882ms
FAIL (2025-08-15 09:19:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 992.428221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
855.354058ms
FAIL (2025-08-15 09:19:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.390825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
806.867598ms
FAIL (2025-08-15 09:18:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 08:57:49.677516921 (159h32m11.636614161s) [upload=166197]: Starting upload Aug 15 08:57:49.677577863 (159h32m11.636675111s) [upload=166197]: Done starting upload Aug 15 08:57:49.677672241 (159h32m11.63676948s) [upload=166197]: Uploading segments... Aug 15 08:57:49.677726585 (159h32m11.636823839s) [upload=166197]: Got next segment. Inline: true Aug 15 08:57:49.677732348 (159h32m11.636829593s) [upload=166197]: Waiting for error group managing segments... Aug 15 08:57:49.677788164 (159h32m11.636885409s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 08:57:49.677793821 (159h32m11.636891067s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 08:57:49.677797613 (159h32m11.636894858s) [upload=166197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 08:57:49.766550039 (159h32m11.725647321s) [upload=166197]: Done uploading segments... Aug 15 08:57:49.766594689 (159h32m11.725691948s) [upload=166197]: Upload finished. err: metaclient: Too Many Requests
Duration: 806.909427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|