Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.312510943s
FAIL (2025-08-17 07:15:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.3125446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
876.755863ms
FAIL (2025-08-17 07:15:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.794799ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
879.190577ms
FAIL (2025-08-17 07:15:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.230037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.434556807s
FAIL (2025-08-17 07:15:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.434600663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.404242508s
FAIL (2025-08-17 07:14:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.404278306s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
814.805422ms
FAIL (2025-08-17 07:14:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.842398ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.457712053s
FAIL (2025-08-17 07:14:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.457757153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.33465161s
FAIL (2025-08-17 07:13:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.334688073s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X............................X..............................] duration:
821.520147ms
FAIL (2025-08-17 07:13:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.560043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.552082601s
FAIL (2025-08-17 07:13:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.552119251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X............................X.............................] duration:
1.357693127s
FAIL (2025-08-17 07:12:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.357727117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X............................X............................] duration:
870.060319ms
FAIL (2025-08-17 07:12:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.092337ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.347822415s
FAIL (2025-08-17 07:12:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.347863703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.45609553s
FAIL (2025-08-17 07:11:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.456414057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X............................X...........................] duration:
834.578053ms
FAIL (2025-08-17 07:11:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.614487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.464723739s
FAIL (2025-08-17 07:11:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.46475963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X............................X..........................] duration:
842.823021ms
FAIL (2025-08-17 07:10:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.882778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X............................X.........................] duration:
1.039411375s
FAIL (2025-08-17 07:10:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.039451518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.742939053s
FAIL (2025-08-17 07:10:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.742975938s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.287058818s
FAIL (2025-08-17 07:09:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.28710693s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X............................X........................] duration:
890.593234ms
FAIL (2025-08-17 07:09:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.647451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.578761276s
FAIL (2025-08-17 07:09:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.578859086s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X............................X.......................] duration:
868.869722ms
FAIL (2025-08-17 07:09:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.912381ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X............................X......................] duration:
870.458866ms
FAIL (2025-08-17 07:08:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.50997ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X............................X.....................] duration:
1.349076653s
FAIL (2025-08-17 07:08:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.349143868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.558583657s
FAIL (2025-08-17 07:08:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.558629394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X............................X....................] duration:
841.224012ms
FAIL (2025-08-17 07:07:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.275935ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.729986512s
FAIL (2025-08-17 07:07:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.730016282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X............................X...................] duration:
983.251443ms
FAIL (2025-08-17 07:07:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 983.28548ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.299495317s
FAIL (2025-08-17 07:07:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.299584536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X............................X..................] duration:
805.074588ms
FAIL (2025-08-17 07:06:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 805.109893ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X............................X.................] duration:
914.439035ms
FAIL (2025-08-17 07:06:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 914.473417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.54080668s
FAIL (2025-08-17 07:06:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.540840287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
3.397306347s
FAIL (2025-08-17 07:05:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 3.397339267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X............................X................] duration:
838.73408ms
FAIL (2025-08-17 07:05:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.77815ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.48490011s
FAIL (2025-08-17 07:05:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.484933123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X............................X...............] duration:
1.074849189s
FAIL (2025-08-17 07:05:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.07487441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X............................X..............] duration:
1.053923667s
FAIL (2025-08-17 07:04:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.053959088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.420266971s
FAIL (2025-08-17 07:03:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.42035191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X............................X.............] duration:
1.014289965s
FAIL (2025-08-17 07:03:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014320211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.894249696s
FAIL (2025-08-17 07:03:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.894283802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.785921446s
FAIL (2025-08-17 07:03:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.785967875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X............................X............] duration:
932.296917ms
FAIL (2025-08-17 07:02:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 932.317911ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X............................X...........] duration:
858.134764ms
FAIL (2025-08-17 07:01:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.173751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.541036099s
FAIL (2025-08-17 07:01:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.541086404s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X............................X..........] duration:
837.828345ms
FAIL (2025-08-17 07:01:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.88351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............................X.........] duration:
1.090136135s
FAIL (2025-08-17 07:01:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.090231007s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.378569338s
FAIL (2025-08-17 07:00:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 2.378633027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
3.474311124s
FAIL (2025-08-17 07:00:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 06:38:45.886635106 (205h13m7.845732351s) [upload=213661]: Starting upload
Aug 17 06:38:45.886689149 (205h13m7.845786395s) [upload=213661]: Done starting upload
Aug 17 06:38:45.886811228 (205h13m7.845908464s) [upload=213661]: Uploading segments...
Aug 17 06:38:45.887015787 (205h13m7.846113037s) [upload=213661]: Got next segment. Inline: false
Aug 17 06:38:45.887103203 (205h13m7.846200657s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 06:38:45.887111640 (205h13m7.846208886s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 06:38:46.085406191 (205h13m8.044503466s) [seg_pos={0 0}, upload=213661]: Begin upload segment...
Aug 17 06:38:46.085482482 (205h13m8.044579728s) [seg_pos={0 0}, upload=213661]: Done begin upload segment.
Aug 17 06:38:46.085537911 (205h13m8.044635166s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.085713813 (205h13m8.044811059s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.086707232 (205h13m8.045804486s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087191280 (205h13m8.046288537s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087218039 (205h13m8.046315296s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087646920 (205h13m8.046744172s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.087669047 (205h13m8.046766302s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088125601 (205h13m8.047222856s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088200964 (205h13m8.04729822s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088502137 (205h13m8.047599392s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.088682902 (205h13m8.047780156s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089052197 (205h13m8.048149453s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089163656 (205h13m8.048260911s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089425000 (205h13m8.048522249s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.089552458 (205h13m8.048649714s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.091128950 (205h13m8.050226218s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.092683120 (205h13m8.051780375s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.093685271 (205h13m8.052782517s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Uploading piece...
Aug 17 06:38:46.647117395 (205h13m8.606214631s) [upload=213661]: Next returned nil segment
Aug 17 06:38:46.647135877 (205h13m8.606233113s) [upload=213661]: Waiting for error group managing segments...
Aug 17 06:38:46.798591976 (205h13m8.757689225s) [noise=true , address=77.90.31.12:4612 , piece_id=U6LCSLHN4EVB2ZIWJSIRUEERNQYP6FAQT4ZCI2TPELDPTNDBJTDQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.799575962 (205h13m8.75867321s) [noise=true , address=45.91.116.6:4991 , piece_id=HV7UPWUJ6PAWXQVCVNGDAWA6YRRTEATITAAOOQQSDV6C45WWDU4Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.800718536 (205h13m8.759815774s) [noise=true , address=45.91.116.6:4976 , piece_id=XKHZ4I6LYR524X35KKETBPPLAIYTJ6V27HQ47DRDPMPMFOO3G35A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.802563162 (205h13m8.761660401s) [noise=true , address=77.90.31.11:4567 , piece_id=YX74EKRVLHTNUPHE7CQY4UGIO25M33DKOUTSCKFAKZKQYZOGNU2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.809723698 (205h13m8.768820934s) [noise=true , address=45.91.116.12:4235 , piece_id=JNPXGQMPUAMYVUCTWBF2OJEZACUXAUJV4JSQIGLPXGKPLXWNEPHQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.813424167 (205h13m8.772521407s) [noise=true , address=45.91.116.7:4034 , piece_id=AAQA4QHS4S2AKKWHVOLNIPJ764X663U2OMIZ2V4SEEAH7TXPEK5A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.814865200 (205h13m8.773962449s) [noise=true , address=104.36.82.36:4625 , piece_id=TFWMD6TTJNREJQRB53MSHIKP2N3V55GSWAZLX73M4FLD337GRY4A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.815947173 (205h13m8.77504441s) [noise=true , address=77.90.31.21:4904 , piece_id=RFMOGDNN2Z2EHFNUXPDJ6DRS2YY7WENNAUBVMK4TS2Z6TNM24ZBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.817752178 (205h13m8.776849419s) [noise=true , address=104.36.82.23:4460 , piece_id=7BCBBUQO2YGIZNNUWQ53Z2KUSCFJFNJ2B5EDZMS7BDPBNVSUE66A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.818409729 (205h13m8.777506966s) [noise=true , address=104.36.82.60:4370 , piece_id=RJ7UGCLD3ANWFBCUPTI3XEZXX3NAMFWHHCZUUTP3QFMHAHXLEQYA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.825690410 (205h13m8.784787661s) [noise=true , address=104.36.82.17:4334 , piece_id=ZNIZFC6YMOFPTSPVAY32YRWNLDIQ2L2BJTCLWYUVTAHGPHTJGEBA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.828830971 (205h13m8.787928225s) [noise=true , address=104.36.82.58:4271 , piece_id=PGWZONS7XUS4F7U3ZGKWFO5FA54IUS3GL6RSYCQTXL5WGMIWPJIA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.867259116 (205h13m8.826356355s) [noise=true , address=104.36.82.34:4569 , piece_id=N2F32VNFY2MPR7W6624ND6F6Y3UKKL3S3XS5IUP2GW4YBYBIQP2Q, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904283895 (205h13m8.863381148s) [noise=true , address=104.36.82.44:4901 , piece_id=OB5YQB22OGRP4GY4WGOQ6EJ24C2HLSQGT56ZLD2UZ3BK2DWH6ILQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: <nil>
Aug 17 06:38:46.904399090 (205h13m8.863496342s) [seg_pos={0 0}, upload=213661]: Segment reached optimal threshold of 14 pieces.
Aug 17 06:38:46.904814266 (205h13m8.863911519s) [noise=true , address=104.36.82.59:4301 , piece_id=XY4YPFWZXYNY3B5ERD5CVP5HNMZBISEOOSV476RBIFRYXMCNPMKA, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905020569 (205h13m8.864117818s) [noise=true , address=66.23.193.175:4563 , piece_id=EARCW4K3UFQTAA3MUWEQUVR7IDI5KLDWKGCB5RSD2VACVHLSY74A, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36930->66.23.193.175:4563: use of closed network connection
Aug 17 06:38:46.905232127 (205h13m8.864329382s) [noise=true , address=79.127.205.245:4234 , piece_id=INPLCHI7PW4PHKVFGFJAFN5T23CQYPDWUOOJZYFDZ4FSIFQQHFLQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJWq44d6y4Ai4tyZpCUvCgZeMHrVdiiSSngTR75YZZXbsgq2d): protocol: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35382->79.127.205.245:4234: use of closed network connection
Aug 17 06:38:46.905290070 (205h13m8.864387316s) [noise=true , address=79.127.201.215:4349 , piece_id=MAMWWENHMHI3HVDXBJKADIQWERLIRJV55VQTRRRK7BA6QDNN64ZQ, seg_pos={0 0}, upload=213661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF
Aug 17 06:38:46.905303723 (205h13m8.864400955s) [seg_pos={0 0}, upload=213661]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 06:38:46.905422255 (205h13m8.864519509s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 06:38:46.905427911 (205h13m8.864525159s) [upload=213661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 06:38:47.064640622 (205h13m9.023737869s) [upload=213661]: Done uploading segments...
Aug 17 06:38:47.064667510 (205h13m9.023764757s) [upload=213661]: Upload finished. err: <nil>
Duration: 3.474365706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X............................X........] duration:
832.376492ms
FAIL (2025-08-17 07:00:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 06:55:06.946049059 (205h29m28.905146306s) [upload=213934]: Starting upload Aug 17 06:55:06.946113563 (205h29m28.905210813s) [upload=213934]: Done starting upload Aug 17 06:55:06.946192131 (205h29m28.90528937s) [upload=213934]: Uploading segments... Aug 17 06:55:06.946250258 (205h29m28.905347514s) [upload=213934]: Got next segment. Inline: true Aug 17 06:55:06.946256034 (205h29m28.90535327s) [upload=213934]: Waiting for error group managing segments... Aug 17 06:55:06.946328648 (205h29m28.905425899s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 06:55:06.946335295 (205h29m28.905432528s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 06:55:06.946338897 (205h29m28.905436156s) [upload=213934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 06:55:07.035332554 (205h29m28.994429805s) [upload=213934]: Done uploading segments... Aug 17 06:55:07.035361778 (205h29m28.994459025s) [upload=213934]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.410131ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|