Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.X....................X.....] duration:
813.000606ms
FAIL (2025-08-14 05:56:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 813.034732ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X.X....................X....] duration:
1.08922756s
FAIL (2025-08-14 05:55:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 1.089265649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..........X.....................] duration:
2.442954091s
FAIL (2025-08-14 05:55:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.442995047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..........X....................] duration:
2.512107749s
FAIL (2025-08-14 05:54:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.512142421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.X....................X...] duration:
1.021283416s
FAIL (2025-08-14 05:54:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 1.021316202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.X....................X..] duration:
828.075692ms
FAIL (2025-08-14 05:54:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 828.133814ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..........X...................] duration:
2.350677546s
FAIL (2025-08-14 05:53:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.350708461s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................X.X....................X.] duration:
848.442393ms
FAIL (2025-08-14 05:53:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 848.478378ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X..........X..................] duration:
2.394127078s
FAIL (2025-08-14 05:52:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.394158541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................................X.X....................X] duration:
607.7866ms
FAIL (2025-08-14 05:52:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 607.83933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X..........X.................] duration:
2.415876472s
FAIL (2025-08-14 05:52:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.415927287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X..........X................] duration:
2.413712351s
FAIL (2025-08-14 05:51:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.413743216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration:
835.379492ms
FAIL (2025-08-14 05:51:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.410864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X..........X...............] duration:
2.35292568s
FAIL (2025-08-14 05:50:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.352964681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.X...................] duration:
815.261456ms
FAIL (2025-08-14 05:50:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.30306ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X..........X..............] duration:
2.24047766s
FAIL (2025-08-14 05:49:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.240504512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration:
838.977476ms
FAIL (2025-08-14 05:49:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.005876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..........X.............] duration:
2.419949885s
FAIL (2025-08-14 05:49:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.419997701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.X.................] duration:
839.972547ms
FAIL (2025-08-14 05:48:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.070762ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..........X............] duration:
2.405949723s
FAIL (2025-08-14 05:48:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.405981589s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration:
2.67685214s
FAIL (2025-08-14 05:47:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.676889431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.X................] duration:
840.960355ms
FAIL (2025-08-14 05:47:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.994314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration:
2.381492908s
FAIL (2025-08-14 05:47:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.381530121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration:
888.571208ms
FAIL (2025-08-14 05:46:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.66665ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration:
2.451823714s
FAIL (2025-08-14 05:46:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.451863217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..........X........] duration:
2.428470059s
FAIL (2025-08-14 05:46:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.428508031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration:
837.222298ms
FAIL (2025-08-14 05:45:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.262813ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..........X.......] duration:
2.361766417s
FAIL (2025-08-14 05:45:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.365052988s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.X.............] duration:
829.18828ms
FAIL (2025-08-14 05:44:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.233116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..........X......] duration:
2.465305616s
FAIL (2025-08-14 05:44:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.465390751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..........X.....] duration:
2.349304616s
FAIL (2025-08-14 05:43:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.349349561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.X............] duration:
877.94898ms
FAIL (2025-08-14 05:43:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.999809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X..........X....] duration:
2.407765648s
FAIL (2025-08-14 05:43:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.407801592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration:
822.277251ms
FAIL (2025-08-14 05:43:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.314916ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration:
841.64563ms
FAIL (2025-08-14 05:42:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.681695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.X.........] duration:
856.242031ms
FAIL (2025-08-14 05:42:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.28276ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X..........X...] duration:
2.478005042s
FAIL (2025-08-14 05:42:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.478097981s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.X........] duration:
853.10253ms
FAIL (2025-08-14 05:42:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.14255ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X..........X..] duration:
2.392766045s
FAIL (2025-08-14 05:41:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.392823057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration:
839.202308ms
FAIL (2025-08-14 05:41:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.246377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X..........X.] duration:
2.33796694s
FAIL (2025-08-14 05:40:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.337995513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X..........X] duration:
1.632977493s
FAIL (2025-08-14 05:40:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 1.633044537s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.X......] duration:
851.576456ms
FAIL (2025-08-14 05:40:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.635108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration:
823.515249ms
FAIL (2025-08-14 05:39:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.548339ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.304949533s
FAIL (2025-08-14 05:39:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5138fa5e1e31d5532b2019bf8dcb8d4bc2d74506200c63b3f9b353ad898018f2 != before c4982af1a950c8cbf6fb91d65e277a29d12fa98dbe7faf007ceb4963f1283995
======LOGS======
Aug 14 05:31:12.241234412 (132h5m34.200331658s) [upload=137614]: Starting upload
Aug 14 05:31:12.241290708 (132h5m34.200387952s) [upload=137614]: Done starting upload
Aug 14 05:31:12.241393644 (132h5m34.200490889s) [upload=137614]: Uploading segments...
Aug 14 05:31:12.241537396 (132h5m34.200634627s) [upload=137614]: Got next segment. Inline: false
Aug 14 05:31:12.241571231 (132h5m34.200668476s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:31:12.241575668 (132h5m34.200672913s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:31:12.441409637 (132h5m34.400506882s) [seg_pos={0 0}, upload=137614]: Begin upload segment...
Aug 14 05:31:12.441496516 (132h5m34.400593765s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.441984316 (132h5m34.401081568s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442029953 (132h5m34.401127207s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442291254 (132h5m34.401388485s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442372720 (132h5m34.401469964s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442601790 (132h5m34.401699021s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442626975 (132h5m34.401724223s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442902426 (132h5m34.401999675s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442952893 (132h5m34.402050141s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443201735 (132h5m34.40229898s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443293322 (132h5m34.40239057s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443485408 (132h5m34.40258264s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443700224 (132h5m34.402797479s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443851465 (132h5m34.40294871s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444034353 (132h5m34.403131598s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444151996 (132h5m34.403249227s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444361067 (132h5m34.403458315s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444664923 (132h5m34.403762171s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.446674543 (132h5m34.405771775s) [seg_pos={0 0}, upload=137614]: Done begin upload segment.
Aug 14 05:31:13.002749918 (132h5m34.961847198s) [upload=137614]: Next returned nil segment
Aug 14 05:31:13.002768496 (132h5m34.961865751s) [upload=137614]: Waiting for error group managing segments...
Aug 14 05:31:13.139988625 (132h5m35.099085856s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.140589772 (132h5m35.099687021s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.143826614 (132h5m35.102923853s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.156411764 (132h5m35.115509003s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.161459903 (132h5m35.120557148s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.166133561 (132h5m35.125230799s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.174991835 (132h5m35.134089067s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.181044037 (132h5m35.140141289s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.183058906 (132h5m35.142156143s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188313575 (132h5m35.147410815s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188367274 (132h5m35.147464506s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.189170202 (132h5m35.148267449s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.196716281 (132h5m35.155813518s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198424889 (132h5m35.157522122s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198459857 (132h5m35.157557117s) [seg_pos={0 0}, upload=137614]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:31:13.198667070 (132h5m35.157764316s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FtB4bKTHntdUQxF8G5o9nT73oS2xB7fgD44BkRfKDNFyZnKCk): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198769293 (132h5m35.157866531s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection
Aug 14 05:31:13.198788487 (132h5m35.157885726s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198899439 (132h5m35.157996671s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection; write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection
Aug 14 05:31:13.198927932 (132h5m35.158025185s) [seg_pos={0 0}, upload=137614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:31:13.199042492 (132h5m35.158139742s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:31:13.199048236 (132h5m35.158145488s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:31:13.352149091 (132h5m35.311246338s) [upload=137614]: Done uploading segments...
Aug 14 05:31:13.352175211 (132h5m35.311272443s) [upload=137614]: Upload finished. err: <nil>
Duration: 2.304983704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration:
817.462863ms
FAIL (2025-08-14 05:38:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.53124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.43483114s
FAIL (2025-08-14 05:38:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5138fa5e1e31d5532b2019bf8dcb8d4bc2d74506200c63b3f9b353ad898018f2 != before c4982af1a950c8cbf6fb91d65e277a29d12fa98dbe7faf007ceb4963f1283995
======LOGS======
Aug 14 05:31:12.241234412 (132h5m34.200331658s) [upload=137614]: Starting upload
Aug 14 05:31:12.241290708 (132h5m34.200387952s) [upload=137614]: Done starting upload
Aug 14 05:31:12.241393644 (132h5m34.200490889s) [upload=137614]: Uploading segments...
Aug 14 05:31:12.241537396 (132h5m34.200634627s) [upload=137614]: Got next segment. Inline: false
Aug 14 05:31:12.241571231 (132h5m34.200668476s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:31:12.241575668 (132h5m34.200672913s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:31:12.441409637 (132h5m34.400506882s) [seg_pos={0 0}, upload=137614]: Begin upload segment...
Aug 14 05:31:12.441496516 (132h5m34.400593765s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.441984316 (132h5m34.401081568s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442029953 (132h5m34.401127207s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442291254 (132h5m34.401388485s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442372720 (132h5m34.401469964s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442601790 (132h5m34.401699021s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442626975 (132h5m34.401724223s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442902426 (132h5m34.401999675s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442952893 (132h5m34.402050141s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443201735 (132h5m34.40229898s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443293322 (132h5m34.40239057s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443485408 (132h5m34.40258264s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443700224 (132h5m34.402797479s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443851465 (132h5m34.40294871s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444034353 (132h5m34.403131598s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444151996 (132h5m34.403249227s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444361067 (132h5m34.403458315s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444664923 (132h5m34.403762171s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.446674543 (132h5m34.405771775s) [seg_pos={0 0}, upload=137614]: Done begin upload segment.
Aug 14 05:31:13.002749918 (132h5m34.961847198s) [upload=137614]: Next returned nil segment
Aug 14 05:31:13.002768496 (132h5m34.961865751s) [upload=137614]: Waiting for error group managing segments...
Aug 14 05:31:13.139988625 (132h5m35.099085856s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.140589772 (132h5m35.099687021s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.143826614 (132h5m35.102923853s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.156411764 (132h5m35.115509003s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.161459903 (132h5m35.120557148s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.166133561 (132h5m35.125230799s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.174991835 (132h5m35.134089067s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.181044037 (132h5m35.140141289s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.183058906 (132h5m35.142156143s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188313575 (132h5m35.147410815s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188367274 (132h5m35.147464506s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.189170202 (132h5m35.148267449s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.196716281 (132h5m35.155813518s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198424889 (132h5m35.157522122s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198459857 (132h5m35.157557117s) [seg_pos={0 0}, upload=137614]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:31:13.198667070 (132h5m35.157764316s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FtB4bKTHntdUQxF8G5o9nT73oS2xB7fgD44BkRfKDNFyZnKCk): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198769293 (132h5m35.157866531s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection
Aug 14 05:31:13.198788487 (132h5m35.157885726s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198899439 (132h5m35.157996671s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection; write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection
Aug 14 05:31:13.198927932 (132h5m35.158025185s) [seg_pos={0 0}, upload=137614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:31:13.199042492 (132h5m35.158139742s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:31:13.199048236 (132h5m35.158145488s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:31:13.352149091 (132h5m35.311246338s) [upload=137614]: Done uploading segments...
Aug 14 05:31:13.352175211 (132h5m35.311272443s) [upload=137614]: Upload finished. err: <nil>
Duration: 2.434869682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.415061936s
FAIL (2025-08-14 05:38:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5138fa5e1e31d5532b2019bf8dcb8d4bc2d74506200c63b3f9b353ad898018f2 != before c4982af1a950c8cbf6fb91d65e277a29d12fa98dbe7faf007ceb4963f1283995
======LOGS======
Aug 14 05:31:12.241234412 (132h5m34.200331658s) [upload=137614]: Starting upload
Aug 14 05:31:12.241290708 (132h5m34.200387952s) [upload=137614]: Done starting upload
Aug 14 05:31:12.241393644 (132h5m34.200490889s) [upload=137614]: Uploading segments...
Aug 14 05:31:12.241537396 (132h5m34.200634627s) [upload=137614]: Got next segment. Inline: false
Aug 14 05:31:12.241571231 (132h5m34.200668476s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:31:12.241575668 (132h5m34.200672913s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:31:12.441409637 (132h5m34.400506882s) [seg_pos={0 0}, upload=137614]: Begin upload segment...
Aug 14 05:31:12.441496516 (132h5m34.400593765s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.441984316 (132h5m34.401081568s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442029953 (132h5m34.401127207s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442291254 (132h5m34.401388485s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442372720 (132h5m34.401469964s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442601790 (132h5m34.401699021s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442626975 (132h5m34.401724223s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442902426 (132h5m34.401999675s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.442952893 (132h5m34.402050141s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443201735 (132h5m34.40229898s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443293322 (132h5m34.40239057s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443485408 (132h5m34.40258264s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443700224 (132h5m34.402797479s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.443851465 (132h5m34.40294871s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444034353 (132h5m34.403131598s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444151996 (132h5m34.403249227s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444361067 (132h5m34.403458315s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.444664923 (132h5m34.403762171s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Uploading piece...
Aug 14 05:31:12.446674543 (132h5m34.405771775s) [seg_pos={0 0}, upload=137614]: Done begin upload segment.
Aug 14 05:31:13.002749918 (132h5m34.961847198s) [upload=137614]: Next returned nil segment
Aug 14 05:31:13.002768496 (132h5m34.961865751s) [upload=137614]: Waiting for error group managing segments...
Aug 14 05:31:13.139988625 (132h5m35.099085856s) [noise=true , address=77.90.31.15:4707 , piece_id=AIKJ6JDTLTKKG7RUBZZICLE5Q34INPL4TNC2DHX3GHHW5EW7PR2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.140589772 (132h5m35.099687021s) [noise=true , address=77.90.31.21:4882 , piece_id=M2WXM5CFPAJWYAVP4BLAOGEEW3KPV2MFOHIAKFKWTNYMSBXVNALQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.143826614 (132h5m35.102923853s) [noise=true , address=77.90.31.12:4600 , piece_id=ETSHTWQ6VDUUXRWIORKZ5LG2RB336WU24ZH6DJC2KHVMSC63BGCQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.156411764 (132h5m35.115509003s) [noise=true , address=77.90.31.18:4811 , piece_id=HRZODTVVZOLKJAQUP2TRSKKBKYGJC7SLAFJWM2UFUINE75THT5JA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.161459903 (132h5m35.120557148s) [noise=true , address=77.90.31.19:4853 , piece_id=CM4MM6YIX3NCFMRN5JU63RJIHI7FKJMTMFY2IQXT6DTP54AXCS3A, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.166133561 (132h5m35.125230799s) [noise=true , address=104.36.82.44:4877 , piece_id=FHPT663D5OJHO6VJHWOIIVD7UFPLF2K74ACSCVJOBE235K3R6TPA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.174991835 (132h5m35.134089067s) [noise=true , address=104.36.82.7:4942 , piece_id=5YO2J3IO4TJDOMASTDJCDBGETM3CEGC4K6PC4PC52TJGDCRGKTHA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.181044037 (132h5m35.140141289s) [noise=true , address=104.36.82.46:4492 , piece_id=N2OPDDFP7QB35N5DAYWGNSZCZ3RBEGWJX3IBPHAR3KOJ45ZL2HXA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.183058906 (132h5m35.142156143s) [noise=true , address=104.36.82.37:4685 , piece_id=6GWHIVIEUID76SBSATBBCPXW57HDFBI6BXLTIEPIPJFQBJKO5DRQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188313575 (132h5m35.147410815s) [noise=true , address=104.36.82.60:4366 , piece_id=LM5UBZUHW3BCWEFWPO6SJ2HGRXGI6KPW4VBHMMRPOTVLWJSBJM2Q, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.188367274 (132h5m35.147464506s) [noise=true , address=104.36.82.22:4518 , piece_id=XGMLDJW7CRBVDAHYTKHG3XX7JPRLYT6OQRVCTZVZ5IVMNQD2EFWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.189170202 (132h5m35.148267449s) [noise=true , address=104.36.82.36:4623 , piece_id=WNXAZJSHGJ7VXIAEZO2MD7PZCKUF23AXG6ALHT6Q6JD2X7GVJMLA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.196716281 (132h5m35.155813518s) [noise=true , address=104.36.82.23:4464 , piece_id=QJJI6ZGJ6EATKXZM3IEKAVL6I6KEZANEUV6FFRTM4PUTCXTV6XMQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198424889 (132h5m35.157522122s) [noise=true , address=104.36.82.58:4276 , piece_id=CVLCSTABKHDECPR3V45HDLUCJBIOCKO2KFVQ7X2XVFPJTE3V3HFQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: <nil>
Aug 14 05:31:13.198459857 (132h5m35.157557117s) [seg_pos={0 0}, upload=137614]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:31:13.198667070 (132h5m35.157764316s) [noise=true , address=77.90.31.17:4782 , piece_id=7Q4PYRNCJMTAZTQC5PXTUW3WAXBQP43KU66ZSZRGKNY2XJQO3TVQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FtB4bKTHntdUQxF8G5o9nT73oS2xB7fgD44BkRfKDNFyZnKCk): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198769293 (132h5m35.157866531s) [noise=true , address=66.23.193.175:4557 , piece_id=6NKYDGBWEVJT5BPMHARQ3AZBBAX5OWYJOAYVQWKEPPRAEBPXDVKQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39358->66.23.193.175:4557: use of closed network connection
Aug 14 05:31:13.198788487 (132h5m35.157885726s) [noise=true , address=104.36.82.61:4408 , piece_id=UA27STNBGXSKTUTPJNJXNT2DFIPY2EPLS3H7CNBIYD2TQXH5QPWA, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF
Aug 14 05:31:13.198899439 (132h5m35.157996671s) [noise=true , address=104.36.82.5:4857 , piece_id=FDNZ67BYXOJXU63MFNAESIS7CPO46WHNFODQIB6OYRQK2MGRD3LQ, seg_pos={0 0}, upload=137614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection; write tcp 139.59.144.22:50290->104.36.82.5:4857: use of closed network connection
Aug 14 05:31:13.198927932 (132h5m35.158025185s) [seg_pos={0 0}, upload=137614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:31:13.199042492 (132h5m35.158139742s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:31:13.199048236 (132h5m35.158145488s) [upload=137614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:31:13.352149091 (132h5m35.311246338s) [upload=137614]: Done uploading segments...
Aug 14 05:31:13.352175211 (132h5m35.311272443s) [upload=137614]: Upload finished. err: <nil>
Duration: 2.41514071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X.X...] duration:
1.067447782s
FAIL (2025-08-14 05:38:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.06749123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration:
849.895365ms
FAIL (2025-08-14 05:37:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:36:49.887216576 (132h11m11.84631383s) [upload=137711]: Starting upload Aug 14 05:36:49.887301843 (132h11m11.846399096s) [upload=137711]: Done starting upload Aug 14 05:36:49.887393232 (132h11m11.846490466s) [upload=137711]: Uploading segments... Aug 14 05:36:49.887472762 (132h11m11.846570016s) [upload=137711]: Got next segment. Inline: true Aug 14 05:36:49.887479372 (132h11m11.846576618s) [upload=137711]: Waiting for error group managing segments... Aug 14 05:36:49.887541690 (132h11m11.846638926s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:36:49.887547537 (132h11m11.846644783s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:36:49.887551216 (132h11m11.846648463s) [upload=137711]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:36:49.976555244 (132h11m11.935652494s) [upload=137711]: Done uploading segments... Aug 14 05:36:49.976573837 (132h11m11.935671083s) [upload=137711]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.935131ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|