Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...........................X.............................] duration:
2.57180179s
FAIL (2025-08-17 01:42:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.571841563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X...................X.......................] duration:
957.609331ms
FAIL (2025-08-17 01:42:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 957.654077ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...................X......................] duration:
961.274558ms
FAIL (2025-08-17 01:41:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 961.386764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...........................X............................] duration:
2.4794923s
FAIL (2025-08-17 01:41:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.479533248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...........................X...........................] duration:
2.452960503s
FAIL (2025-08-17 01:40:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.452984949s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...................X.....................] duration:
918.494019ms
FAIL (2025-08-17 01:40:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 918.52759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...................X....................] duration:
898.949309ms
FAIL (2025-08-17 01:40:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 899.055282ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...........................X..........................] duration:
2.726658845s
FAIL (2025-08-17 01:40:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.726700352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...........................X.........................] duration:
2.335843577s
FAIL (2025-08-17 01:39:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.335888053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...................X...................] duration:
917.694195ms
FAIL (2025-08-17 01:38:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 917.731004ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...................X..................] duration:
930.892188ms
FAIL (2025-08-17 01:38:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 930.938057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...........................X........................] duration:
2.625836929s
FAIL (2025-08-17 01:38:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.625889876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...................X.................] duration:
1.095198426s
FAIL (2025-08-17 01:37:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.095240344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...........................X.......................] duration:
2.485982889s
FAIL (2025-08-17 01:37:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.486137659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...........................X......................] duration:
2.568916469s
FAIL (2025-08-17 01:37:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.568955786s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...................X................] duration:
1.152916149s
FAIL (2025-08-17 01:36:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.152944344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...........................X.....................] duration:
2.523107584s
FAIL (2025-08-17 01:36:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.523132534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X...........................X....................] duration:
2.388337803s
FAIL (2025-08-17 01:35:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.388454567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X...................X...............] duration:
878.974862ms
FAIL (2025-08-17 01:35:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.008065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...................X..............] duration:
1.014666198s
FAIL (2025-08-17 01:34:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014763743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X...........................X...................] duration:
2.516138003s
FAIL (2025-08-17 01:34:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.516171563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...................X.............] duration:
880.661717ms
FAIL (2025-08-17 01:34:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.698583ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X...........................X..................] duration:
2.513750643s
FAIL (2025-08-17 01:33:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.513897951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X...........................X.................] duration:
2.538738373s
FAIL (2025-08-17 01:33:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.538771316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X...........................X................] duration:
2.708970645s
FAIL (2025-08-17 01:33:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.70910072s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...................X............] duration:
861.586322ms
FAIL (2025-08-17 01:33:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.628714ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X...................X...........] duration:
829.760336ms
FAIL (2025-08-17 01:32:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.792241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X...........................X...............] duration:
2.667709653s
FAIL (2025-08-17 01:32:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.66773756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...........................X..............] duration:
2.351333919s
FAIL (2025-08-17 01:31:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.351369923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...................X..........] duration:
927.259383ms
FAIL (2025-08-17 01:31:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 927.295683ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...........................X.............] duration:
2.518861153s
FAIL (2025-08-17 01:30:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.51889774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...................X.........] duration:
874.704965ms
FAIL (2025-08-17 01:30:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.744274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...........................X............] duration:
2.426418444s
FAIL (2025-08-17 01:30:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.426470525s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...................X........] duration:
838.361867ms
FAIL (2025-08-17 01:29:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.430087ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...........................X...........] duration:
2.662050922s
FAIL (2025-08-17 01:29:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.66208291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...........................X..........] duration:
2.63521277s
FAIL (2025-08-17 01:29:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.635243736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...........................X.........] duration:
2.499377407s
FAIL (2025-08-17 01:28:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.499414701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X...................X.......] duration:
900.650506ms
FAIL (2025-08-17 01:28:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 900.681529ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...................X......] duration:
884.623432ms
FAIL (2025-08-17 01:28:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.660269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...........................X........] duration:
2.494295252s
FAIL (2025-08-17 01:27:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.494350606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...................X.....] duration:
892.367893ms
FAIL (2025-08-17 01:27:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.417318ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...........................X.......] duration:
2.587883078s
FAIL (2025-08-17 01:26:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.587922556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..................................X...................X....] duration:
922.261701ms
FAIL (2025-08-17 01:26:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 922.293845ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...........................X......] duration:
2.598519993s
FAIL (2025-08-17 01:25:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.598552218s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..................................X...................X...] duration:
887.141942ms
FAIL (2025-08-17 01:25:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.184441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..................................X...................X..] duration:
931.032237ms
FAIL (2025-08-17 01:24:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 931.060682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...........................X.....] duration:
2.629875966s
FAIL (2025-08-17 01:24:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.629908135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..................................X...................X.] duration:
989.214011ms
FAIL (2025-08-17 01:24:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.24178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...........................X....] duration:
2.402284513s
FAIL (2025-08-17 01:23:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 01:20:57.834357025 (199h55m19.793454274s) [upload=208086]: Starting upload
Aug 17 01:20:57.834450602 (199h55m19.793547854s) [upload=208086]: Done starting upload
Aug 17 01:20:57.834600885 (199h55m19.793698184s) [upload=208086]: Uploading segments...
Aug 17 01:20:57.834877189 (199h55m19.793974429s) [upload=208086]: Got next segment. Inline: false
Aug 17 01:20:57.834930937 (199h55m19.794028182s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 01:20:57.834936229 (199h55m19.794033474s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 01:20:58.054650564 (199h55m20.013747812s) [seg_pos={0 0}, upload=208086]: Begin upload segment...
Aug 17 01:20:58.054722530 (199h55m20.013819766s) [seg_pos={0 0}, upload=208086]: Done begin upload segment.
Aug 17 01:20:58.054761835 (199h55m20.01385911s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.054780236 (199h55m20.013877491s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055197364 (199h55m20.014294613s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055285703 (199h55m20.014382958s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055539320 (199h55m20.014636636s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.055715308 (199h55m20.014812563s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056127258 (199h55m20.015224523s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056274245 (199h55m20.015371501s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056484818 (199h55m20.015582066s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056671730 (199h55m20.015768988s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.056787079 (199h55m20.015884312s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057058793 (199h55m20.016156047s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057448535 (199h55m20.016545793s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.057836898 (199h55m20.016934153s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.058318451 (199h55m20.017415707s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059012496 (199h55m20.018109752s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059443945 (199h55m20.0185412s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.059870162 (199h55m20.018967417s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Uploading piece...
Aug 17 01:20:58.612326560 (199h55m20.571423798s) [upload=208086]: Next returned nil segment
Aug 17 01:20:58.612344549 (199h55m20.571441794s) [upload=208086]: Waiting for error group managing segments...
Aug 17 01:20:58.785434659 (199h55m20.74453191s) [noise=true , address=77.90.31.16:4740 , piece_id=HZAQHLYRQSR5FR7CY4ABNCALAL2MTUKGVVWS5UNY5PQTZY6NRPNA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.790738463 (199h55m20.749835713s) [noise=true , address=104.36.82.39:4747 , piece_id=PZZBWIARVYJW2IO67YIHARJTW6QVHKTI355TIHCJADRQRF3BQHLA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.791064735 (199h55m20.750161972s) [noise=true , address=45.91.116.10:4085 , piece_id=XVPF6AXAR6EUKDVUO72H6PF5BQLL5BSS4S4S42ZVBWEGEGEHHOQA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.795652494 (199h55m20.75474974s) [noise=true , address=45.91.116.9:4280 , piece_id=HAH43ZL3N6U6JFTIJGWKEBSHP24I23GV2SXGUUJZLPLIAUKKLWIA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.798251014 (199h55m20.75734826s) [noise=true , address=77.90.31.19:4875 , piece_id=ZTBHBZEG6GNFKZ3276VP5XRA627HAI2ISYLNOSWQIQVT6C2UQSXQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.800180925 (199h55m20.759278165s) [noise=true , address=45.91.116.4:4948 , piece_id=THANAESKGJKNU4EORWDLNJUYWZNPQNGE53TVVYQICZZGBUUJQ7XA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.801494057 (199h55m20.760591289s) [noise=true , address=104.36.82.37:4667 , piece_id=ZKZB4VTPQGQXEBMHBA4EFSQFEAZ6WZR2NNVLO7BNOP2MMGI35AGQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.809600054 (199h55m20.768697291s) [noise=true , address=77.90.31.18:4830 , piece_id=HISO6UV5A7CU6BMZBN74SZG4QRBUN4YMKAAU7W3YOWDTIFBUSC7A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.810298582 (199h55m20.76939582s) [noise=true , address=104.36.82.34:4580 , piece_id=EJYGX55XIQ5FAIYXJV6RJOVRKPPB3FVS3GIQB6TQV53LP7GVR5TA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.817268878 (199h55m20.776366123s) [noise=true , address=104.36.82.19:4434 , piece_id=TKFDUUNXDLZAEJNS7VY6ETWV3RHTVGOA7DIKWQH4BN77ARVQ362Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.828834853 (199h55m20.787932084s) [noise=true , address=45.91.116.5:4321 , piece_id=FDUKALCFRMKWBA5ZKQD66TPTUOI5PS3I66UBYXZZ7VDZMK6MNDOQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.833467405 (199h55m20.792564646s) [noise=true , address=104.36.82.40:4959 , piece_id=MB7HGH7L752YP322ZLGG7ZBMEZ53PN3GKZVHJBGYBS6UDIYDSS5A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.839378356 (199h55m20.798475603s) [noise=true , address=104.36.82.39:4725 , piece_id=TMYBHPDN2X4AJEXZ6ADG3ZUJ2S4RTHNTVYBI4NBONFDTP7BDZJBQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865816433 (199h55m20.82491368s) [noise=true , address=104.36.82.11:4147 , piece_id=RMMZ4UJ7Z54NYOYLPJ3WP7GIZPS7YX4IDYAA6QBFVX3HK6FRO55Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: <nil>
Aug 17 01:20:58.865873548 (199h55m20.8249708s) [seg_pos={0 0}, upload=208086]: Segment reached optimal threshold of 14 pieces.
Aug 17 01:20:58.866179717 (199h55m20.825276962s) [noise=true , address=104.36.82.38:4707 , piece_id=XPYBGFECVKE45D37FJSW7JYTKZ4L2CP3ROX2XRDCR5D77EHAG6KA, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866312242 (199h55m20.825409481s) [noise=true , address=45.91.116.7:4019 , piece_id=4NAD2YWXUO3NODOWNJQW2WN74VUFOG6LVSAMCUBM7KF3V3N7KU5Q, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 17 01:20:58.866385954 (199h55m20.825483193s) [noise=true , address=79.127.205.245:4240 , piece_id=ZK2XPQKTINQQZRKOUPJF4QJPXXVBQUPWJJHSL6GI5LMLWVTN3HKQ, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G3XLZZWwo1fbWMbaWZkL1LdwTa61YshMcm7BhV2GoeB1TRN38): protocol: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60064->79.127.205.245:4240: use of closed network connection
Aug 17 01:20:58.866393615 (199h55m20.82549086s) [noise=true , address=77.90.31.13:4656 , piece_id=FQQG5UZGUFQAC7FJP5LXMC6HSHA6QBQUG34ZX2A7GJUA3GA4L47A, seg_pos={0 0}, upload=208086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59848->77.90.31.13:4656: use of closed network connection
Aug 17 01:20:58.866410447 (199h55m20.825507692s) [seg_pos={0 0}, upload=208086]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 01:20:58.866498001 (199h55m20.825595246s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 01:20:58.866503137 (199h55m20.825600382s) [upload=208086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 01:20:59.042313781 (199h55m21.001411014s) [upload=208086]: Done uploading segments...
Aug 17 01:20:59.042339905 (199h55m21.001437154s) [upload=208086]: Upload finished. err: <nil>
Duration: 2.402322936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..................................X...................X] duration:
369.22102ms
FAIL (2025-08-17 01:23:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 01:23:07.264650147 (199h57m29.223747393s) [upload=208129]: Starting upload Aug 17 01:23:07.264711969 (199h57m29.223809215s) [upload=208129]: Done starting upload Aug 17 01:23:07.264814377 (199h57m29.223911623s) [upload=208129]: Uploading segments... Aug 17 01:23:07.264872273 (199h57m29.223969527s) [upload=208129]: Got next segment. Inline: true Aug 17 01:23:07.264878322 (199h57m29.223975574s) [upload=208129]: Waiting for error group managing segments... Aug 17 01:23:07.264930420 (199h57m29.224027665s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 01:23:07.264935371 (199h57m29.224032616s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 01:23:07.264939227 (199h57m29.224036473s) [upload=208129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 01:23:07.354972858 (199h57m29.314070102s) [upload=208129]: Done uploading segments... Aug 17 01:23:07.354990780 (199h57m29.314088026s) [upload=208129]: Upload finished. err: metaclient: Too Many Requests
Duration: 369.245042ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|