Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.X..........................] duration:
872.997066ms
FAIL (2025-08-13 11:07:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.025843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.442092673s
FAIL (2025-08-13 11:07:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.442124928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.X.........................] duration:
829.353129ms
FAIL (2025-08-13 11:06:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.401172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.472805843s
FAIL (2025-08-13 11:06:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.472835723s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.X........................] duration:
852.659825ms
FAIL (2025-08-13 11:06:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.693409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration:
827.673822ms
FAIL (2025-08-13 11:05:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.699973ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.X......................] duration:
840.362433ms
FAIL (2025-08-13 11:05:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.394259ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.459238193s
FAIL (2025-08-13 11:05:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.459268972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration:
868.750892ms
FAIL (2025-08-13 11:04:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.788187ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.322478064s
FAIL (2025-08-13 11:04:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.322515394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.489101859s
FAIL (2025-08-13 11:03:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.48915739s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration:
999.135468ms
FAIL (2025-08-13 11:03:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 999.177817ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.359207926s
FAIL (2025-08-13 11:03:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.359237003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.X...................] duration:
876.826696ms
FAIL (2025-08-13 11:03:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.864693ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.353219963s
FAIL (2025-08-13 11:03:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.353267856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration:
1.279634417s
FAIL (2025-08-13 11:02:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.279671502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.537576107s
FAIL (2025-08-13 11:02:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.537628662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration:
2.469003291s
FAIL (2025-08-13 11:01:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.469045748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.X.................] duration:
1.246920892s
FAIL (2025-08-13 11:01:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.246952975s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration:
2.4059003s
FAIL (2025-08-13 11:00:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.405938051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.X................] duration:
1.02148859s
FAIL (2025-08-13 11:00:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.021531927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration:
839.081511ms
FAIL (2025-08-13 10:59:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.113556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
2.62425608s
FAIL (2025-08-13 10:59:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.624295752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration:
998.145591ms
FAIL (2025-08-13 10:59:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 998.177915ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.X.............] duration:
830.253324ms
FAIL (2025-08-13 10:58:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.289446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
2.406152503s
FAIL (2025-08-13 10:58:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.406191594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.X............] duration:
845.668786ms
FAIL (2025-08-13 10:58:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.725815ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
2.559803524s
FAIL (2025-08-13 10:57:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.559854529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration:
835.646793ms
FAIL (2025-08-13 10:57:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.679242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
2.401560977s
FAIL (2025-08-13 10:57:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.40163282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration:
852.649831ms
FAIL (2025-08-13 10:57:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.681647ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration:
2.616968202s
FAIL (2025-08-13 10:56:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.617008616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.X.........] duration:
981.287202ms
FAIL (2025-08-13 10:56:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 981.388134ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration:
2.293161773s
FAIL (2025-08-13 10:55:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.293207818s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.X........] duration:
1.033457513s
FAIL (2025-08-13 10:55:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.033607299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration:
2.539406085s
FAIL (2025-08-13 10:55:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.539440991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.....................................X............] duration:
2.454870358s
FAIL (2025-08-13 10:54:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.45490462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration:
850.571522ms
FAIL (2025-08-13 10:54:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.680727ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.....................................X...........] duration:
2.444350429s
FAIL (2025-08-13 10:53:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.444383264s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.X......] duration:
836.020285ms
FAIL (2025-08-13 10:53:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.066403ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.....................................X..........] duration:
2.538562671s
FAIL (2025-08-13 10:52:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.538601695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration:
1.02209691s
FAIL (2025-08-13 10:51:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.022130071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.....................................X.........] duration:
2.439332088s
FAIL (2025-08-13 10:51:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.439365415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration:
826.47407ms
FAIL (2025-08-13 10:51:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.505261ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X.X...] duration:
1.002506356s
FAIL (2025-08-13 10:50:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.002542505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.....................................X........] duration:
2.583417049s
FAIL (2025-08-13 10:50:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.583450561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration:
860.163664ms
FAIL (2025-08-13 10:49:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 860.195412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.....................................X.......] duration:
2.373721085s
FAIL (2025-08-13 10:49:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.373771511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................................X.X.] duration:
865.928937ms
FAIL (2025-08-13 10:48:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 10:47:13.903561538 (113h21m35.862658783s) [upload=118067]: Starting upload Aug 13 10:47:13.903621085 (113h21m35.862718334s) [upload=118067]: Done starting upload Aug 13 10:47:13.903743442 (113h21m35.862840695s) [upload=118067]: Uploading segments... Aug 13 10:47:13.903841969 (113h21m35.862939224s) [upload=118067]: Got next segment. Inline: true Aug 13 10:47:13.903850396 (113h21m35.862947664s) [upload=118067]: Waiting for error group managing segments... Aug 13 10:47:13.903899008 (113h21m35.862996252s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 10:47:13.903904534 (113h21m35.86300178s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 10:47:13.903908401 (113h21m35.863005647s) [upload=118067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 10:47:13.991421589 (113h21m35.950518847s) [upload=118067]: Done uploading segments... Aug 13 10:47:13.991446198 (113h21m35.950543461s) [upload=118067]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.957575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.....................................X......] duration:
2.389979002s
FAIL (2025-08-13 10:48:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 10:43:46.820560683 (113h18m8.779657916s) [upload=118007]: Starting upload
Aug 13 10:43:46.820656631 (113h18m8.77975388s) [upload=118007]: Done starting upload
Aug 13 10:43:46.820830931 (113h18m8.779928197s) [upload=118007]: Uploading segments...
Aug 13 10:43:46.821037868 (113h18m8.780135105s) [upload=118007]: Got next segment. Inline: false
Aug 13 10:43:46.821083851 (113h18m8.780181096s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 10:43:46.821092566 (113h18m8.780189814s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 10:43:47.026455090 (113h18m8.985552339s) [seg_pos={0 0}, upload=118007]: Begin upload segment...
Aug 13 10:43:47.026520969 (113h18m8.985618221s) [seg_pos={0 0}, upload=118007]: Done begin upload segment.
Aug 13 10:43:47.026539732 (113h18m8.985636992s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026598401 (113h18m8.985695647s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.026665231 (113h18m8.985762463s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.027535254 (113h18m8.986632509s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028023063 (113h18m8.987120319s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028293225 (113h18m8.987390476s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028533242 (113h18m8.987630498s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.028802160 (113h18m8.987899421s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.029278494 (113h18m8.988375746s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.030553192 (113h18m8.989650447s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031112182 (113h18m8.990209433s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.031578332 (113h18m8.990675584s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.032023655 (113h18m8.991120907s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033049883 (113h18m8.992147135s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.033614129 (113h18m8.992711384s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.034044861 (113h18m8.993142118s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.035704068 (113h18m8.99480132s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.036153444 (113h18m8.995250699s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Uploading piece...
Aug 13 10:43:47.600517894 (113h18m9.559615146s) [upload=118007]: Next returned nil segment
Aug 13 10:43:47.600539190 (113h18m9.559636445s) [upload=118007]: Waiting for error group managing segments...
Aug 13 10:43:47.736201463 (113h18m9.695298703s) [noise=true , address=77.90.31.19:4859 , piece_id=SO7TNBHQZKAIXK6ATYTTGTIX6SESWUTEL2GU3SA4B3YYJOC527BQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.736297304 (113h18m9.695394542s) [noise=true , address=77.90.31.12:4624 , piece_id=7OGKF7IV6TJKCZCM4L23CE3K5BJAPDPTLUNBED4HGQNA7IGUDJGQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.737032203 (113h18m9.696129445s) [noise=true , address=77.90.31.14:4669 , piece_id=UOBW3JDWNSG2EGVS2R3JSFFT2ZPRWQ66YIW2QRNPQZ22BMVF2I5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.744019539 (113h18m9.703116786s) [noise=true , address=79.127.219.48:4075 , piece_id=BH7XE5OROUIAGZTIKDXXOUF5XUELL5QGQMX2XK6Z6H7QM5FLFFVQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.761964038 (113h18m9.721061276s) [noise=true , address=104.36.82.38:4701 , piece_id=7HJWD4Z7LN5Z3KLAQMWMXMVAFGR3GC3T3HYBUYPENGESVMIIEPCQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.768845548 (113h18m9.727942789s) [noise=true , address=77.90.31.11:4566 , piece_id=YPSZWGDG7JMXOC3LOC3U2ALZBLVFBXRD6AAEE64PRU6DRBXKH4LQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.784170041 (113h18m9.743267279s) [noise=true , address=104.36.82.13:4192 , piece_id=7G5DJHBZ23POZ5F7QMMP3LIRLJTWX3YVELSWJN3PQPG5MQF6IJAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791025905 (113h18m9.750123142s) [noise=true , address=104.36.82.37:4673 , piece_id=HXFDWLGO2TKSEYQQANBUJ2BEOF5X4GRRHCJODXVG6KB5FYHLANMA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.791341184 (113h18m9.750438433s) [noise=true , address=104.36.82.36:4629 , piece_id=PI2CIX3SZROIBL56DNE777UYFO5ZMTSZEJ3ZV2YST5H5KWS4E23A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.793697332 (113h18m9.752794568s) [noise=true , address=104.36.82.23:4457 , piece_id=W2WJDNSLRMDXRH2S7RBL3JQ5HFTCCQSXN4NE6ODRJKA6JFZ2FOQQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.794263575 (113h18m9.753360813s) [noise=true , address=104.36.82.60:4371 , piece_id=PQA2EWC233YNDINNCX3Q6U73D4ICZEQO4VMWPLN3P3MJP4FX54IA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.820035538 (113h18m9.77913277s) [noise=true , address=77.90.31.13:4654 , piece_id=3ABSZZSTLB7LZZLZIAB4UHAIW77YVGRYTLHA72GDQ2SI7PPP4MHA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.845835007 (113h18m9.80493224s) [noise=true , address=104.36.82.9:4025 , piece_id=EB7T5L54FAGGTKUHPW6HYBJTKYKVELA4U4IAW4JB76KGJUV3WKAA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882119650 (113h18m9.841216905s) [noise=true , address=79.127.220.101:4074 , piece_id=Z5GJHYUXTJA5L5WFH5IEDUJSLNEQ7H5Y37OIMOHEEQHJRDJBSPSA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: <nil>
Aug 13 10:43:47.882199450 (113h18m9.841296708s) [seg_pos={0 0}, upload=118007]: Segment reached optimal threshold of 14 pieces.
Aug 13 10:43:47.882683387 (113h18m9.84178063s) [noise=true , address=64.49.13.139:4469 , piece_id=TAJOQPAE6UN5N3UPKQ364C6WZGSZ4QAX6WJFEZDQEGKNQV3HOP5A, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37492->64.49.13.139:4469: use of closed network connection
Aug 13 10:43:47.882894121 (113h18m9.841991378s) [noise=true , address=64.49.13.169:4711 , piece_id=64TBECERLOGHTU76FKWQLXVZWN2RW2ULC4E6LPZ34JXKFUFXONPA, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.169:4711: use of closed network connection
Aug 13 10:43:47.882994310 (113h18m9.84209156s) [noise=true , address=79.127.201.215:4356 , piece_id=XE3MQ6YNFVOOIMUFLR6AANWI5OVZZG4X4KDOQKGJWYKKLGULKD5Q, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 10:43:47.883023932 (113h18m9.842121171s) [noise=true , address=66.23.193.175:4555 , piece_id=NSA7VY3QOXE3W34UPLY65TO5YWE3DNTKGBSHJZ6CIY74UCDCCCOQ, seg_pos={0 0}, upload=118007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34548->66.23.193.175:4555: use of closed network connection
Aug 13 10:43:47.883053924 (113h18m9.842151159s) [seg_pos={0 0}, upload=118007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 10:43:47.883146209 (113h18m9.842243446s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 10:43:47.883154068 (113h18m9.842251314s) [upload=118007]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 10:43:48.055416348 (113h18m10.014513614s) [upload=118007]: Done uploading segments...
Aug 13 10:43:48.055438652 (113h18m10.014547702s) [upload=118007]: Upload finished. err: <nil>
Duration: 2.390034684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|