Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.510558509s
FAIL (2025-08-12 18:30:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1d0ff28b7efeba95587a8587f6610e7949b4820783637c1c921108db7cc2d982 != before 31da930ab750481aa3340545c28d1ec4d66a05bb9e95706dc0484c97777af69a
======LOGS======
Aug 12 18:29:57.028870055 (97h4m18.987967293s) [upload=101139]: Starting upload
Aug 12 18:29:57.029155298 (97h4m18.988252554s) [upload=101139]: Done starting upload
Aug 12 18:29:57.029286488 (97h4m18.98838374s) [upload=101139]: Uploading segments...
Aug 12 18:29:57.029656618 (97h4m18.988753894s) [upload=101139]: Got next segment. Inline: false
Aug 12 18:29:57.029752186 (97h4m18.988849445s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 18:29:57.029759366 (97h4m18.988856621s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 18:29:57.233468164 (97h4m19.19256541s) [seg_pos={0 0}, upload=101139]: Begin upload segment...
Aug 12 18:29:57.233528313 (97h4m19.192625548s) [seg_pos={0 0}, upload=101139]: Done begin upload segment.
Aug 12 18:29:57.233568364 (97h4m19.192665609s) [noise=true , address=104.36.82.58:4289 , piece_id=RAFBE2F5WUZCORTE7BU2SMXVMZ76JSHULHHMAFXYEYJQOA4FXPPA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234028575 (97h4m19.193125831s) [noise=true , address=64.49.13.170:4725 , piece_id=QRVMCGMA5LOQNVNGLZ56YU27ADWQLCVGSTP52ZFUABBMHAGDRB7A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234129832 (97h4m19.193227086s) [noise=true , address=104.36.82.60:4341 , piece_id=KV6U2VAZ6YQVQ27LAEFUT4YDKUYZ7OHCZKV3CHJCHCRXY4775UMA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234503688 (97h4m19.193600944s) [noise=true , address=79.127.220.101:4066 , piece_id=MHBK543ET7FWCNDOSF6HMBSMCSXIKPIAL6YWEHMT3MNQEKIGGKBQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234574925 (97h4m19.193672181s) [noise=true , address=104.36.82.36:4642 , piece_id=3RY3BIDFTV42JFT2BHFFBV2WCBHFJLANNA7IYNGBGMTWZ6EZQX2A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234871481 (97h4m19.193968736s) [noise=true , address=104.36.82.18:4370 , piece_id=WIRB53SELUGCNFCYGQHB2SBSSPNZ3YZXZTIK65DXRIJ2SHWUELPA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234989283 (97h4m19.194086533s) [noise=true , address=104.36.82.17:4336 , piece_id=CLCORRQ2CEXKJ2Z64UXEO3NIMB542YYENKJJIAAMEXJWEMAZ3TOA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235230494 (97h4m19.194327741s) [noise=true , address=104.36.82.4:4831 , piece_id=KT7OKKR6XAYL6PZ7GOJXMEVHT3FVT5YIL3BU7JKBPL2ZQAXMJCHA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235438897 (97h4m19.19453615s) [noise=true , address=104.36.82.13:4207 , piece_id=IY4XP3XGOCWKEDHVLWMUWL4FNBAHYEI3U7ICM6ETQG27QYJJ5G7A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235587095 (97h4m19.194684348s) [noise=true , address=104.36.82.19:4434 , piece_id=FXWEORYF25GZU7O73KRGZT4DTPMPDD5A25JOIQYQAIWHSKTCEW6A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235910535 (97h4m19.195007786s) [noise=true , address=104.36.82.59:4313 , piece_id=OL5ZYIQFMLM7U3IPI3XSF55PHSQ6BF6QMCQ7LBXPFYFAZF45FH4A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235983338 (97h4m19.195080595s) [noise=true , address=79.127.205.233:4625 , piece_id=S5SQLR6VYS2UUJ7KC6MBNGQH2IMVID6BWUYFMKRX3CR3OIGSUF6A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.236366913 (97h4m19.195464162s) [noise=true , address=104.36.82.34:4574 , piece_id=JFDPHJAB4LAWDKQCTQA4MKKKJ6YVWUW4NQ42E7LXPIB3Y3M5R27Q, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.236798272 (97h4m19.195895524s) [noise=true , address=64.49.13.26:4945 , piece_id=ABQ647LBNTDK4YDWGLBAKMPGW7XGPCZ5XEWR2ZXUAAVW3RT32WDQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.237319121 (97h4m19.196416378s) [noise=true , address=66.23.193.175:4553 , piece_id=7EJYPMXSDWF2RF5PCHUBT5UJCBWV5DYY7HFEGXFOCR3AASI2CFSA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.239209262 (97h4m19.198306518s) [noise=true , address=104.36.82.61:4384 , piece_id=3MYLCFXEXFBONINZS53D7OXCL6AVVLTUYIOHXRWZLTTONN35Y2IQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.239910065 (97h4m19.199007321s) [noise=true , address=104.36.82.39:4749 , piece_id=Q6TUOLXPWB7RQP6ENPK7SSZADCFECWSKQ4BDPT5UFMIB7TK6KNAA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.240072862 (97h4m19.199170117s) [noise=true , address=79.127.219.51:4181 , piece_id=QQT53VS5BRXRVZUNZVAQULUD4J6BZEZIN4P7NPTDPG3TTRHXHHPQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.823810708 (97h4m19.782907987s) [upload=101139]: Next returned nil segment
Aug 12 18:29:57.823836261 (97h4m19.782933514s) [upload=101139]: Waiting for error group managing segments...
Aug 12 18:29:57.984225256 (97h4m19.943322499s) [noise=true , address=104.36.82.18:4370 , piece_id=WIRB53SELUGCNFCYGQHB2SBSSPNZ3YZXZTIK65DXRIJ2SHWUELPA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.990431560 (97h4m19.949528821s) [noise=true , address=104.36.82.19:4434 , piece_id=FXWEORYF25GZU7O73KRGZT4DTPMPDD5A25JOIQYQAIWHSKTCEW6A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.995596649 (97h4m19.954693893s) [noise=true , address=104.36.82.34:4574 , piece_id=JFDPHJAB4LAWDKQCTQA4MKKKJ6YVWUW4NQ42E7LXPIB3Y3M5R27Q, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.995986767 (97h4m19.955084005s) [noise=true , address=104.36.82.13:4207 , piece_id=IY4XP3XGOCWKEDHVLWMUWL4FNBAHYEI3U7ICM6ETQG27QYJJ5G7A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.004914563 (97h4m19.964011803s) [noise=true , address=104.36.82.58:4289 , piece_id=RAFBE2F5WUZCORTE7BU2SMXVMZ76JSHULHHMAFXYEYJQOA4FXPPA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.006502169 (97h4m19.965599416s) [noise=true , address=104.36.82.17:4336 , piece_id=CLCORRQ2CEXKJ2Z64UXEO3NIMB542YYENKJJIAAMEXJWEMAZ3TOA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.010921313 (97h4m19.970018546s) [noise=true , address=104.36.82.60:4341 , piece_id=KV6U2VAZ6YQVQ27LAEFUT4YDKUYZ7OHCZKV3CHJCHCRXY4775UMA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.011316451 (97h4m19.970413686s) [noise=true , address=104.36.82.61:4384 , piece_id=3MYLCFXEXFBONINZS53D7OXCL6AVVLTUYIOHXRWZLTTONN35Y2IQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.013461242 (97h4m19.972558488s) [noise=true , address=104.36.82.36:4642 , piece_id=3RY3BIDFTV42JFT2BHFFBV2WCBHFJLANNA7IYNGBGMTWZ6EZQX2A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.015721013 (97h4m19.974818246s) [noise=true , address=79.127.219.51:4181 , piece_id=QQT53VS5BRXRVZUNZVAQULUD4J6BZEZIN4P7NPTDPG3TTRHXHHPQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.016742866 (97h4m19.975840098s) [noise=true , address=104.36.82.39:4749 , piece_id=Q6TUOLXPWB7RQP6ENPK7SSZADCFECWSKQ4BDPT5UFMIB7TK6KNAA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.017329730 (97h4m19.976426962s) [noise=true , address=104.36.82.4:4831 , piece_id=KT7OKKR6XAYL6PZ7GOJXMEVHT3FVT5YIL3BU7JKBPL2ZQAXMJCHA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.129246446 (97h4m20.088343683s) [noise=true , address=104.36.82.59:4313 , piece_id=OL5ZYIQFMLM7U3IPI3XSF55PHSQ6BF6QMCQ7LBXPFYFAZF45FH4A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.183254999 (97h4m20.142352247s) [noise=true , address=79.127.220.101:4066 , piece_id=MHBK543ET7FWCNDOSF6HMBSMCSXIKPIAL6YWEHMT3MNQEKIGGKBQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.183284510 (97h4m20.142381757s) [seg_pos={0 0}, upload=101139]: Segment reached optimal threshold of 14 pieces.
Aug 12 18:29:58.183738039 (97h4m20.142835286s) [noise=true , address=66.23.193.175:4553 , piece_id=7EJYPMXSDWF2RF5PCHUBT5UJCBWV5DYY7HFEGXFOCR3AASI2CFSA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14ZJ9cf9uqJqtXTkP9VL2KU5YdCJfUVSyJkfRwJ6K7SpRB5zME): protocol: write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection; write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection
Aug 12 18:29:58.183808478 (97h4m20.142905726s) [noise=true , address=64.49.13.26:4945 , piece_id=ABQ647LBNTDK4YDWGLBAKMPGW7XGPCZ5XEWR2ZXUAAVW3RT32WDQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection
Aug 12 18:29:58.183872094 (97h4m20.142969341s) [noise=true , address=64.49.13.170:4725 , piece_id=QRVMCGMA5LOQNVNGLZ56YU27ADWQLCVGSTP52ZFUABBMHAGDRB7A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection
Aug 12 18:29:58.183999683 (97h4m20.143096931s) [noise=true , address=79.127.205.233:4625 , piece_id=S5SQLR6VYS2UUJ7KC6MBNGQH2IMVID6BWUYFMKRX3CR3OIGSUF6A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection
Aug 12 18:29:58.184021447 (97h4m20.143118695s) [seg_pos={0 0}, upload=101139]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 18:29:58.184108547 (97h4m20.1432058s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 18:29:58.184114400 (97h4m20.143211651s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 18:29:58.357566087 (97h4m20.316663355s) [upload=101139]: Done uploading segments...
Aug 12 18:29:58.357602115 (97h4m20.316699361s) [upload=101139]: Upload finished. err: <nil>
Duration: 2.510618801s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X................X.........................] duration:
907.970406ms
FAIL (2025-08-12 18:30:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.033771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.488478717s
FAIL (2025-08-12 18:29:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1d0ff28b7efeba95587a8587f6610e7949b4820783637c1c921108db7cc2d982 != before 31da930ab750481aa3340545c28d1ec4d66a05bb9e95706dc0484c97777af69a
======LOGS======
Aug 12 18:29:57.028870055 (97h4m18.987967293s) [upload=101139]: Starting upload
Aug 12 18:29:57.029155298 (97h4m18.988252554s) [upload=101139]: Done starting upload
Aug 12 18:29:57.029286488 (97h4m18.98838374s) [upload=101139]: Uploading segments...
Aug 12 18:29:57.029656618 (97h4m18.988753894s) [upload=101139]: Got next segment. Inline: false
Aug 12 18:29:57.029752186 (97h4m18.988849445s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 18:29:57.029759366 (97h4m18.988856621s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 18:29:57.233468164 (97h4m19.19256541s) [seg_pos={0 0}, upload=101139]: Begin upload segment...
Aug 12 18:29:57.233528313 (97h4m19.192625548s) [seg_pos={0 0}, upload=101139]: Done begin upload segment.
Aug 12 18:29:57.233568364 (97h4m19.192665609s) [noise=true , address=104.36.82.58:4289 , piece_id=RAFBE2F5WUZCORTE7BU2SMXVMZ76JSHULHHMAFXYEYJQOA4FXPPA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234028575 (97h4m19.193125831s) [noise=true , address=64.49.13.170:4725 , piece_id=QRVMCGMA5LOQNVNGLZ56YU27ADWQLCVGSTP52ZFUABBMHAGDRB7A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234129832 (97h4m19.193227086s) [noise=true , address=104.36.82.60:4341 , piece_id=KV6U2VAZ6YQVQ27LAEFUT4YDKUYZ7OHCZKV3CHJCHCRXY4775UMA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234503688 (97h4m19.193600944s) [noise=true , address=79.127.220.101:4066 , piece_id=MHBK543ET7FWCNDOSF6HMBSMCSXIKPIAL6YWEHMT3MNQEKIGGKBQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234574925 (97h4m19.193672181s) [noise=true , address=104.36.82.36:4642 , piece_id=3RY3BIDFTV42JFT2BHFFBV2WCBHFJLANNA7IYNGBGMTWZ6EZQX2A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234871481 (97h4m19.193968736s) [noise=true , address=104.36.82.18:4370 , piece_id=WIRB53SELUGCNFCYGQHB2SBSSPNZ3YZXZTIK65DXRIJ2SHWUELPA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.234989283 (97h4m19.194086533s) [noise=true , address=104.36.82.17:4336 , piece_id=CLCORRQ2CEXKJ2Z64UXEO3NIMB542YYENKJJIAAMEXJWEMAZ3TOA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235230494 (97h4m19.194327741s) [noise=true , address=104.36.82.4:4831 , piece_id=KT7OKKR6XAYL6PZ7GOJXMEVHT3FVT5YIL3BU7JKBPL2ZQAXMJCHA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235438897 (97h4m19.19453615s) [noise=true , address=104.36.82.13:4207 , piece_id=IY4XP3XGOCWKEDHVLWMUWL4FNBAHYEI3U7ICM6ETQG27QYJJ5G7A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235587095 (97h4m19.194684348s) [noise=true , address=104.36.82.19:4434 , piece_id=FXWEORYF25GZU7O73KRGZT4DTPMPDD5A25JOIQYQAIWHSKTCEW6A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235910535 (97h4m19.195007786s) [noise=true , address=104.36.82.59:4313 , piece_id=OL5ZYIQFMLM7U3IPI3XSF55PHSQ6BF6QMCQ7LBXPFYFAZF45FH4A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.235983338 (97h4m19.195080595s) [noise=true , address=79.127.205.233:4625 , piece_id=S5SQLR6VYS2UUJ7KC6MBNGQH2IMVID6BWUYFMKRX3CR3OIGSUF6A, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.236366913 (97h4m19.195464162s) [noise=true , address=104.36.82.34:4574 , piece_id=JFDPHJAB4LAWDKQCTQA4MKKKJ6YVWUW4NQ42E7LXPIB3Y3M5R27Q, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.236798272 (97h4m19.195895524s) [noise=true , address=64.49.13.26:4945 , piece_id=ABQ647LBNTDK4YDWGLBAKMPGW7XGPCZ5XEWR2ZXUAAVW3RT32WDQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.237319121 (97h4m19.196416378s) [noise=true , address=66.23.193.175:4553 , piece_id=7EJYPMXSDWF2RF5PCHUBT5UJCBWV5DYY7HFEGXFOCR3AASI2CFSA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.239209262 (97h4m19.198306518s) [noise=true , address=104.36.82.61:4384 , piece_id=3MYLCFXEXFBONINZS53D7OXCL6AVVLTUYIOHXRWZLTTONN35Y2IQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.239910065 (97h4m19.199007321s) [noise=true , address=104.36.82.39:4749 , piece_id=Q6TUOLXPWB7RQP6ENPK7SSZADCFECWSKQ4BDPT5UFMIB7TK6KNAA, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.240072862 (97h4m19.199170117s) [noise=true , address=79.127.219.51:4181 , piece_id=QQT53VS5BRXRVZUNZVAQULUD4J6BZEZIN4P7NPTDPG3TTRHXHHPQ, seg_pos={0 0}, upload=101139]: Uploading piece...
Aug 12 18:29:57.823810708 (97h4m19.782907987s) [upload=101139]: Next returned nil segment
Aug 12 18:29:57.823836261 (97h4m19.782933514s) [upload=101139]: Waiting for error group managing segments...
Aug 12 18:29:57.984225256 (97h4m19.943322499s) [noise=true , address=104.36.82.18:4370 , piece_id=WIRB53SELUGCNFCYGQHB2SBSSPNZ3YZXZTIK65DXRIJ2SHWUELPA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.990431560 (97h4m19.949528821s) [noise=true , address=104.36.82.19:4434 , piece_id=FXWEORYF25GZU7O73KRGZT4DTPMPDD5A25JOIQYQAIWHSKTCEW6A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.995596649 (97h4m19.954693893s) [noise=true , address=104.36.82.34:4574 , piece_id=JFDPHJAB4LAWDKQCTQA4MKKKJ6YVWUW4NQ42E7LXPIB3Y3M5R27Q, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:57.995986767 (97h4m19.955084005s) [noise=true , address=104.36.82.13:4207 , piece_id=IY4XP3XGOCWKEDHVLWMUWL4FNBAHYEI3U7ICM6ETQG27QYJJ5G7A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.004914563 (97h4m19.964011803s) [noise=true , address=104.36.82.58:4289 , piece_id=RAFBE2F5WUZCORTE7BU2SMXVMZ76JSHULHHMAFXYEYJQOA4FXPPA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.006502169 (97h4m19.965599416s) [noise=true , address=104.36.82.17:4336 , piece_id=CLCORRQ2CEXKJ2Z64UXEO3NIMB542YYENKJJIAAMEXJWEMAZ3TOA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.010921313 (97h4m19.970018546s) [noise=true , address=104.36.82.60:4341 , piece_id=KV6U2VAZ6YQVQ27LAEFUT4YDKUYZ7OHCZKV3CHJCHCRXY4775UMA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.011316451 (97h4m19.970413686s) [noise=true , address=104.36.82.61:4384 , piece_id=3MYLCFXEXFBONINZS53D7OXCL6AVVLTUYIOHXRWZLTTONN35Y2IQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.013461242 (97h4m19.972558488s) [noise=true , address=104.36.82.36:4642 , piece_id=3RY3BIDFTV42JFT2BHFFBV2WCBHFJLANNA7IYNGBGMTWZ6EZQX2A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.015721013 (97h4m19.974818246s) [noise=true , address=79.127.219.51:4181 , piece_id=QQT53VS5BRXRVZUNZVAQULUD4J6BZEZIN4P7NPTDPG3TTRHXHHPQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.016742866 (97h4m19.975840098s) [noise=true , address=104.36.82.39:4749 , piece_id=Q6TUOLXPWB7RQP6ENPK7SSZADCFECWSKQ4BDPT5UFMIB7TK6KNAA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.017329730 (97h4m19.976426962s) [noise=true , address=104.36.82.4:4831 , piece_id=KT7OKKR6XAYL6PZ7GOJXMEVHT3FVT5YIL3BU7JKBPL2ZQAXMJCHA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.129246446 (97h4m20.088343683s) [noise=true , address=104.36.82.59:4313 , piece_id=OL5ZYIQFMLM7U3IPI3XSF55PHSQ6BF6QMCQ7LBXPFYFAZF45FH4A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.183254999 (97h4m20.142352247s) [noise=true , address=79.127.220.101:4066 , piece_id=MHBK543ET7FWCNDOSF6HMBSMCSXIKPIAL6YWEHMT3MNQEKIGGKBQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: <nil>
Aug 12 18:29:58.183284510 (97h4m20.142381757s) [seg_pos={0 0}, upload=101139]: Segment reached optimal threshold of 14 pieces.
Aug 12 18:29:58.183738039 (97h4m20.142835286s) [noise=true , address=66.23.193.175:4553 , piece_id=7EJYPMXSDWF2RF5PCHUBT5UJCBWV5DYY7HFEGXFOCR3AASI2CFSA, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14ZJ9cf9uqJqtXTkP9VL2KU5YdCJfUVSyJkfRwJ6K7SpRB5zME): protocol: write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection; write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43136->66.23.193.175:4553: use of closed network connection
Aug 12 18:29:58.183808478 (97h4m20.142905726s) [noise=true , address=64.49.13.26:4945 , piece_id=ABQ647LBNTDK4YDWGLBAKMPGW7XGPCZ5XEWR2ZXUAAVW3RT32WDQ, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54066->64.49.13.26:4945: use of closed network connection
Aug 12 18:29:58.183872094 (97h4m20.142969341s) [noise=true , address=64.49.13.170:4725 , piece_id=QRVMCGMA5LOQNVNGLZ56YU27ADWQLCVGSTP52ZFUABBMHAGDRB7A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection; write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59508->64.49.13.170:4725: use of closed network connection
Aug 12 18:29:58.183999683 (97h4m20.143096931s) [noise=true , address=79.127.205.233:4625 , piece_id=S5SQLR6VYS2UUJ7KC6MBNGQH2IMVID6BWUYFMKRX3CR3OIGSUF6A, seg_pos={0 0}, upload=101139]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51688->79.127.205.233:4625: use of closed network connection
Aug 12 18:29:58.184021447 (97h4m20.143118695s) [seg_pos={0 0}, upload=101139]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 18:29:58.184108547 (97h4m20.1432058s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 18:29:58.184114400 (97h4m20.143211651s) [upload=101139]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 18:29:58.357566087 (97h4m20.316663355s) [upload=101139]: Done uploading segments...
Aug 12 18:29:58.357602115 (97h4m20.316699361s) [upload=101139]: Upload finished. err: <nil>
Duration: 2.488513027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X................X........................] duration:
1.000070476s
FAIL (2025-08-12 18:29:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.000102785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X................X.......................] duration:
1.020843127s
FAIL (2025-08-12 18:28:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.020870751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X................X......................] duration:
864.178867ms
FAIL (2025-08-12 18:28:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.21807ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.7448548s
FAIL (2025-08-12 18:27:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.744889879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X................X.....................] duration:
866.552498ms
FAIL (2025-08-12 18:26:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.585475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X................X....................] duration:
911.159545ms
FAIL (2025-08-12 18:26:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 911.364349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.393659517s
FAIL (2025-08-12 18:26:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.393773348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X................X...................] duration:
985.519637ms
FAIL (2025-08-12 18:25:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 985.549454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X................X..................] duration:
947.232948ms
FAIL (2025-08-12 18:25:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 947.281405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.669016985s
FAIL (2025-08-12 18:25:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.66907816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X................X.................] duration:
935.797041ms
FAIL (2025-08-12 18:24:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 935.825957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.024398363s
FAIL (2025-08-12 18:23:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 3.024429113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.324124506s
FAIL (2025-08-12 18:23:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.324175513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X................X................] duration:
841.668771ms
FAIL (2025-08-12 18:22:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.7047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.352187536s
FAIL (2025-08-12 18:22:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.352216551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..........................X................X...............] duration:
832.158647ms
FAIL (2025-08-12 18:21:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.193801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.380515728s
FAIL (2025-08-12 18:21:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.380549177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..........................X................X..............] duration:
855.344545ms
FAIL (2025-08-12 18:21:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.389443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..........................X................X.............] duration:
855.626489ms
FAIL (2025-08-12 18:20:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.668228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.479539263s
FAIL (2025-08-12 18:20:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.479573965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.73070452s
FAIL (2025-08-12 18:20:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.730829143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..........................X................X............] duration:
839.437974ms
FAIL (2025-08-12 18:20:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.461443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..........................X................X...........] duration:
831.280245ms
FAIL (2025-08-12 18:19:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.310314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........................X................X..........] duration:
821.292699ms
FAIL (2025-08-12 18:19:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.331698ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.582495751s
FAIL (2025-08-12 18:18:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.582550471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..........................X................X.........] duration:
913.683514ms
FAIL (2025-08-12 18:18:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 913.705311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.974618569s
FAIL (2025-08-12 18:17:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.974660791s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........................X................X........] duration:
970.421474ms
FAIL (2025-08-12 18:17:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 970.451888ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.676934466s
FAIL (2025-08-12 18:17:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.676976172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..........................X................X.......] duration:
907.977616ms
FAIL (2025-08-12 18:16:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.014126ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.585660278s
FAIL (2025-08-12 18:16:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.58569154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........................X................X......] duration:
968.060072ms
FAIL (2025-08-12 18:15:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 968.099373ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.434186254s
FAIL (2025-08-12 18:15:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.434273358s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........................X................X.....] duration:
853.123435ms
FAIL (2025-08-12 18:15:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.310371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.849735112s
FAIL (2025-08-12 18:14:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.849771409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........................X................X....] duration:
1.019233091s
FAIL (2025-08-12 18:14:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.019255728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..........................X................X...] duration:
939.055751ms
FAIL (2025-08-12 18:14:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 939.132591ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.534929576s
FAIL (2025-08-12 18:13:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.534965125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........................X................X..] duration:
987.000023ms
FAIL (2025-08-12 18:13:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 987.053206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.40649024s
FAIL (2025-08-12 18:12:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.406595457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........................X................X.] duration:
1.0858188s
FAIL (2025-08-12 18:12:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.085840403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.364493611s
FAIL (2025-08-12 18:12:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.36452411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........................X................X] duration:
465.098263ms
FAIL (2025-08-12 18:11:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:11:33.614037455 (96h45m55.573134693s) [upload=100830]: Starting upload Aug 12 18:11:33.614097297 (96h45m55.573194548s) [upload=100830]: Done starting upload Aug 12 18:11:33.614212417 (96h45m55.573309657s) [upload=100830]: Uploading segments... Aug 12 18:11:33.614320153 (96h45m55.57341741s) [upload=100830]: Got next segment. Inline: true Aug 12 18:11:33.614327570 (96h45m55.573424815s) [upload=100830]: Waiting for error group managing segments... Aug 12 18:11:33.614382697 (96h45m55.573479942s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:11:33.614388481 (96h45m55.573485726s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:11:33.614392014 (96h45m55.573489259s) [upload=100830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:11:33.801492840 (96h45m55.760590085s) [upload=100830]: Done uploading segments... Aug 12 18:11:33.801510499 (96h45m55.760607745s) [upload=100830]: Upload finished. err: metaclient: Too Many Requests
Duration: 465.141203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.588961103s
FAIL (2025-08-12 18:11:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.588994464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.373642285s
FAIL (2025-08-12 18:10:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.373670894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X..........................X................] duration:
879.582325ms
FAIL (2025-08-12 18:10:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 17:58:07.719595600 (96h32m29.678692846s) [upload=100585]: Starting upload
Aug 12 17:58:07.719666927 (96h32m29.678764165s) [upload=100585]: Done starting upload
Aug 12 17:58:07.719740386 (96h32m29.678837685s) [upload=100585]: Uploading segments...
Aug 12 17:58:07.719794614 (96h32m29.678891874s) [upload=100585]: Got next segment. Inline: true
Aug 12 17:58:07.719800092 (96h32m29.678897338s) [upload=100585]: Waiting for error group managing segments...
Aug 12 17:58:07.719855494 (96h32m29.67895274s) [upload=100585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:07.719863240 (96h32m29.678960475s) [upload=100585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 17:58:07.719867129 (96h32m29.678964378s) [upload=100585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:07.934860901 (96h32m29.893958136s) [upload=100585]: Done uploading segments...
Aug 12 17:58:07.934899729 (96h32m29.893996973s) [upload=100585]: Upload finished. err: <nil>
Duration: 879.608269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.444261952s
FAIL (2025-08-12 18:09:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 17:38:42.807650944 (96h13m4.766748193s) [upload=100251]: Starting upload
Aug 12 17:38:42.807741056 (96h13m4.766838302s) [upload=100251]: Done starting upload
Aug 12 17:38:42.807877918 (96h13m4.766975156s) [upload=100251]: Uploading segments...
Aug 12 17:38:42.808162409 (96h13m4.767259645s) [upload=100251]: Got next segment. Inline: false
Aug 12 17:38:42.808197832 (96h13m4.767295077s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:38:42.808203254 (96h13m4.767300499s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:38:43.009617386 (96h13m4.968714637s) [seg_pos={0 0}, upload=100251]: Begin upload segment...
Aug 12 17:38:43.009708741 (96h13m4.968805993s) [seg_pos={0 0}, upload=100251]: Done begin upload segment.
Aug 12 17:38:43.009747903 (96h13m4.968845159s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010449649 (96h13m4.969546899s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.010953494 (96h13m4.970050739s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011338926 (96h13m4.970436172s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.011664230 (96h13m4.970761477s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.012496657 (96h13m4.971593906s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.013974240 (96h13m4.973071486s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015062768 (96h13m4.974160017s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015372397 (96h13m4.974469645s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.015649205 (96h13m4.974746456s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.016544032 (96h13m4.975641277s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017401848 (96h13m4.976499096s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.017706982 (96h13m4.97680423s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018038526 (96h13m4.977135775s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018343434 (96h13m4.977440707s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018676939 (96h13m4.977774187s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.018960659 (96h13m4.978057911s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.019294159 (96h13m4.978391405s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Uploading piece...
Aug 12 17:38:43.601800729 (96h13m5.56089796s) [upload=100251]: Next returned nil segment
Aug 12 17:38:43.601820985 (96h13m5.56091823s) [upload=100251]: Waiting for error group managing segments...
Aug 12 17:38:43.762153074 (96h13m5.721250331s) [noise=true , address=104.36.82.39:4744 , piece_id=NNOA5KUD4Z5FI5AIYDVSMDZOX6WLE75XNGMMZALSHRNWWB2R2Y2Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.763530647 (96h13m5.722627883s) [noise=true , address=104.36.82.17:4337 , piece_id=FQ7UXUCCBH5IAPECHXTKI6ZO45SV5X7OEPWFLO3P64CNF4IIVWHQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.765970756 (96h13m5.725068012s) [noise=true , address=104.36.82.59:4315 , piece_id=G4GEM53NUXWZHNEEF5F2UOCQWYMTZI2E5VJH5P4W6KUPUZNQ2P7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.766930267 (96h13m5.726027525s) [noise=true , address=104.36.82.38:4719 , piece_id=YS5RE3AGZU22XGYMWLKDU4FVJ4X2XBCDO4I3TG5NI42JENGFHAMQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.772538005 (96h13m5.73163526s) [noise=true , address=104.36.82.8:4977 , piece_id=XHWJI77T2YVJRV3BMIBRE4LGK5W6O7OVAB5ZU6HXVGX7RDAJTEZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.780346852 (96h13m5.739444099s) [noise=true , address=104.36.82.37:4671 , piece_id=IAE54VRIRCJHH44RVDKBU3BE3TT44GKET62BGVMPPSY2BKCAXCZA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.783634322 (96h13m5.742731583s) [noise=true , address=104.36.82.19:4435 , piece_id=XDWG4GLOH2T7BDAUGEUBG55GOTJM7YMPHC5SHMRTNDSJ7TC2IFDQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.788159533 (96h13m5.747256768s) [noise=true , address=104.36.82.58:4288 , piece_id=2ZCVBAM3T3HE4N2B5THRMSEFDY3EMEYCSGGTHNJY7NM7VMU3S4BA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.789933011 (96h13m5.749030256s) [noise=true , address=77.90.31.18:4834 , piece_id=OKPLQGNYHKOGNIFALKU5H4T5ZYZPQX5G7NLX6P5YW6Y3M2AT57CA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.790575024 (96h13m5.749672261s) [noise=true , address=104.36.82.4:4826 , piece_id=SYFH3TREK6IGGMRVUXHYPBVS3CLBVLUSDJHISOY4MXW6EPMVF2UQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.791121067 (96h13m5.750218306s) [noise=true , address=104.36.82.6:4891 , piece_id=53IUNGRIOHDO2O6X7GNAZY75OK2CE6FG5AY2Z4GE45XNCVSDRVTQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.804876415 (96h13m5.763973654s) [noise=true , address=104.36.82.5:4862 , piece_id=ZCKJV4ZFEPCYGXZSCPI7D6N5DVBLYWEF2YOAXIL37PITBQL4RSCQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.819516451 (96h13m5.778613697s) [noise=true , address=45.91.116.9:4278 , piece_id=NKI7DQ3TK2GWSZKBRNPESQFZTSWA3RHEU655XDPAHN7NDUGJGG7Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855190472 (96h13m5.814287711s) [noise=true , address=104.36.82.22:4509 , piece_id=XR4TBMVV2R5QK4MNWBQ2ABOWLIACBWIS7KFWXBFENPXSAB4CAYWA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: <nil>
Aug 12 17:38:43.855218190 (96h13m5.814315436s) [seg_pos={0 0}, upload=100251]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:38:43.855406308 (96h13m5.814503544s) [noise=true , address=77.90.31.21:4902 , piece_id=LYDVHOA3ZOOSUKE5NMFMCDOKCE4JODUC36AKMMJJCS2VKCT5QXVQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855491347 (96h13m5.814588586s) [noise=true , address=79.127.201.214:4305 , piece_id=T7T7EJEF622RMDN4YAA7L24VLQZ2WWLL7GR6EF6FSTM433O5FCHA, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLYBv5M6NE1Njgfz4WdagyLUqPJyc9WjEgr1CfVVEcso7HnCX): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855602317 (96h13m5.81469956s) [noise=true , address=104.36.82.18:4376 , piece_id=GR5GOTODCJEGTYDRWJRLEWT662KJ56BYX7PLMCQG6FRRJXQ63LZQ, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QfYPc1vbgwcnEWk67Bfbt5KiQ8sq322VKe951PFMTF6VaTzAR): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855736156 (96h13m5.814833388s) [noise=true , address=104.36.82.23:4472 , piece_id=IMQ7ZIBLUATBNWSQ27RSG4D3ESGMCQ5ERLJKRNTYFACYX57IH37Q, seg_pos={0 0}, upload=100251]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 12 17:38:43.855757870 (96h13m5.814855126s) [seg_pos={0 0}, upload=100251]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:38:43.855861085 (96h13m5.814958331s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:38:43.855866798 (96h13m5.814964043s) [upload=100251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:38:44.151144207 (96h13m6.110241443s) [upload=100251]: Done uploading segments...
Aug 12 17:38:44.151184789 (96h13m6.110282029s) [upload=100251]: Upload finished. err: <nil>
Duration: 2.444361872s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|