Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X............................................X...] duration:
2.381932872s
FAIL (2025-08-14 01:28:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 01:25:39.185023141 (128h0m1.144120387s) [upload=133326]: Starting upload
Aug 14 01:25:39.185097117 (128h0m1.144194363s) [upload=133326]: Done starting upload
Aug 14 01:25:39.185201912 (128h0m1.144299148s) [upload=133326]: Uploading segments...
Aug 14 01:25:39.185429852 (128h0m1.144527097s) [upload=133326]: Got next segment. Inline: false
Aug 14 01:25:39.185479447 (128h0m1.144576694s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 01:25:39.185485593 (128h0m1.144582828s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 01:25:39.505204464 (128h0m1.464301719s) [seg_pos={0 0}, upload=133326]: Begin upload segment...
Aug 14 01:25:39.505290557 (128h0m1.464387813s) [seg_pos={0 0}, upload=133326]: Done begin upload segment.
Aug 14 01:25:39.505330530 (128h0m1.464427812s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505341200 (128h0m1.464438441s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505862315 (128h0m1.46495957s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505886119 (128h0m1.464983374s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506372614 (128h0m1.465469863s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506833542 (128h0m1.465930812s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507204213 (128h0m1.466301467s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507591054 (128h0m1.466688299s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507943416 (128h0m1.467040673s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508345418 (128h0m1.467442666s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508718973 (128h0m1.467816228s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509139450 (128h0m1.468236702s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509273376 (128h0m1.468370631s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509758049 (128h0m1.468855301s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510231881 (128h0m1.469329141s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510425169 (128h0m1.469522448s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510834818 (128h0m1.469932075s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.511227047 (128h0m1.470324302s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:40.079686717 (128h0m2.038783968s) [upload=133326]: Next returned nil segment
Aug 14 01:25:40.079709535 (128h0m2.038806799s) [upload=133326]: Waiting for error group managing segments...
Aug 14 01:25:40.226631746 (128h0m2.185728997s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232231748 (128h0m2.191328987s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232656760 (128h0m2.191754006s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.233220024 (128h0m2.192317255s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.234923421 (128h0m2.194020668s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.236856350 (128h0m2.195953588s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248445835 (128h0m2.207543087s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248698438 (128h0m2.207795684s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.256213367 (128h0m2.215310624s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.263321060 (128h0m2.222418306s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.265210041 (128h0m2.224307276s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.266319081 (128h0m2.225416332s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.268508654 (128h0m2.227605886s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269361789 (128h0m2.228459053s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269381029 (128h0m2.228478265s) [seg_pos={0 0}, upload=133326]: Segment reached optimal threshold of 14 pieces.
Aug 14 01:25:40.269524038 (128h0m2.228621289s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bkhuJ5T8SgGFMn6vv6wWnHiJarcMgVuhk6JNmNZoskzwP1gVi): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269651867 (128h0m2.228749114s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269981339 (128h0m2.229078597s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection
Aug 14 01:25:40.270079432 (128h0m2.229176684s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection
Aug 14 01:25:40.270097051 (128h0m2.229194303s) [seg_pos={0 0}, upload=133326]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 01:25:40.270182388 (128h0m2.22927964s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 01:25:40.270188303 (128h0m2.229285555s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 01:25:40.596377153 (128h0m2.555474392s) [upload=133326]: Done uploading segments...
Aug 14 01:25:40.596400407 (128h0m2.555497654s) [upload=133326]: Upload finished. err: <nil>
Duration: 2.381965654s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.....X................] duration:
1.013556129s
FAIL (2025-08-14 01:27:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.01359183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X............................................X..] duration:
2.407320521s
FAIL (2025-08-14 01:27:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 01:25:39.185023141 (128h0m1.144120387s) [upload=133326]: Starting upload
Aug 14 01:25:39.185097117 (128h0m1.144194363s) [upload=133326]: Done starting upload
Aug 14 01:25:39.185201912 (128h0m1.144299148s) [upload=133326]: Uploading segments...
Aug 14 01:25:39.185429852 (128h0m1.144527097s) [upload=133326]: Got next segment. Inline: false
Aug 14 01:25:39.185479447 (128h0m1.144576694s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 01:25:39.185485593 (128h0m1.144582828s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 01:25:39.505204464 (128h0m1.464301719s) [seg_pos={0 0}, upload=133326]: Begin upload segment...
Aug 14 01:25:39.505290557 (128h0m1.464387813s) [seg_pos={0 0}, upload=133326]: Done begin upload segment.
Aug 14 01:25:39.505330530 (128h0m1.464427812s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505341200 (128h0m1.464438441s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505862315 (128h0m1.46495957s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505886119 (128h0m1.464983374s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506372614 (128h0m1.465469863s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506833542 (128h0m1.465930812s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507204213 (128h0m1.466301467s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507591054 (128h0m1.466688299s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507943416 (128h0m1.467040673s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508345418 (128h0m1.467442666s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508718973 (128h0m1.467816228s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509139450 (128h0m1.468236702s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509273376 (128h0m1.468370631s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509758049 (128h0m1.468855301s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510231881 (128h0m1.469329141s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510425169 (128h0m1.469522448s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510834818 (128h0m1.469932075s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.511227047 (128h0m1.470324302s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:40.079686717 (128h0m2.038783968s) [upload=133326]: Next returned nil segment
Aug 14 01:25:40.079709535 (128h0m2.038806799s) [upload=133326]: Waiting for error group managing segments...
Aug 14 01:25:40.226631746 (128h0m2.185728997s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232231748 (128h0m2.191328987s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232656760 (128h0m2.191754006s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.233220024 (128h0m2.192317255s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.234923421 (128h0m2.194020668s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.236856350 (128h0m2.195953588s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248445835 (128h0m2.207543087s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248698438 (128h0m2.207795684s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.256213367 (128h0m2.215310624s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.263321060 (128h0m2.222418306s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.265210041 (128h0m2.224307276s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.266319081 (128h0m2.225416332s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.268508654 (128h0m2.227605886s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269361789 (128h0m2.228459053s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269381029 (128h0m2.228478265s) [seg_pos={0 0}, upload=133326]: Segment reached optimal threshold of 14 pieces.
Aug 14 01:25:40.269524038 (128h0m2.228621289s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bkhuJ5T8SgGFMn6vv6wWnHiJarcMgVuhk6JNmNZoskzwP1gVi): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269651867 (128h0m2.228749114s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269981339 (128h0m2.229078597s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection
Aug 14 01:25:40.270079432 (128h0m2.229176684s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection
Aug 14 01:25:40.270097051 (128h0m2.229194303s) [seg_pos={0 0}, upload=133326]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 01:25:40.270182388 (128h0m2.22927964s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 01:25:40.270188303 (128h0m2.229285555s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 01:25:40.596377153 (128h0m2.555474392s) [upload=133326]: Done uploading segments...
Aug 14 01:25:40.596400407 (128h0m2.555497654s) [upload=133326]: Upload finished. err: <nil>
Duration: 2.407375153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X............................................X.] duration:
3.018477861s
FAIL (2025-08-14 01:26:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 01:25:39.185023141 (128h0m1.144120387s) [upload=133326]: Starting upload
Aug 14 01:25:39.185097117 (128h0m1.144194363s) [upload=133326]: Done starting upload
Aug 14 01:25:39.185201912 (128h0m1.144299148s) [upload=133326]: Uploading segments...
Aug 14 01:25:39.185429852 (128h0m1.144527097s) [upload=133326]: Got next segment. Inline: false
Aug 14 01:25:39.185479447 (128h0m1.144576694s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 01:25:39.185485593 (128h0m1.144582828s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 01:25:39.505204464 (128h0m1.464301719s) [seg_pos={0 0}, upload=133326]: Begin upload segment...
Aug 14 01:25:39.505290557 (128h0m1.464387813s) [seg_pos={0 0}, upload=133326]: Done begin upload segment.
Aug 14 01:25:39.505330530 (128h0m1.464427812s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505341200 (128h0m1.464438441s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505862315 (128h0m1.46495957s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505886119 (128h0m1.464983374s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506372614 (128h0m1.465469863s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506833542 (128h0m1.465930812s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507204213 (128h0m1.466301467s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507591054 (128h0m1.466688299s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507943416 (128h0m1.467040673s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508345418 (128h0m1.467442666s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508718973 (128h0m1.467816228s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509139450 (128h0m1.468236702s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509273376 (128h0m1.468370631s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509758049 (128h0m1.468855301s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510231881 (128h0m1.469329141s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510425169 (128h0m1.469522448s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510834818 (128h0m1.469932075s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.511227047 (128h0m1.470324302s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:40.079686717 (128h0m2.038783968s) [upload=133326]: Next returned nil segment
Aug 14 01:25:40.079709535 (128h0m2.038806799s) [upload=133326]: Waiting for error group managing segments...
Aug 14 01:25:40.226631746 (128h0m2.185728997s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232231748 (128h0m2.191328987s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232656760 (128h0m2.191754006s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.233220024 (128h0m2.192317255s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.234923421 (128h0m2.194020668s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.236856350 (128h0m2.195953588s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248445835 (128h0m2.207543087s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248698438 (128h0m2.207795684s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.256213367 (128h0m2.215310624s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.263321060 (128h0m2.222418306s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.265210041 (128h0m2.224307276s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.266319081 (128h0m2.225416332s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.268508654 (128h0m2.227605886s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269361789 (128h0m2.228459053s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269381029 (128h0m2.228478265s) [seg_pos={0 0}, upload=133326]: Segment reached optimal threshold of 14 pieces.
Aug 14 01:25:40.269524038 (128h0m2.228621289s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bkhuJ5T8SgGFMn6vv6wWnHiJarcMgVuhk6JNmNZoskzwP1gVi): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269651867 (128h0m2.228749114s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269981339 (128h0m2.229078597s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection
Aug 14 01:25:40.270079432 (128h0m2.229176684s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection
Aug 14 01:25:40.270097051 (128h0m2.229194303s) [seg_pos={0 0}, upload=133326]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 01:25:40.270182388 (128h0m2.22927964s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 01:25:40.270188303 (128h0m2.229285555s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 01:25:40.596377153 (128h0m2.555474392s) [upload=133326]: Done uploading segments...
Aug 14 01:25:40.596400407 (128h0m2.555497654s) [upload=133326]: Upload finished. err: <nil>
Duration: 3.018516022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.....X...............] duration:
853.521112ms
FAIL (2025-08-14 01:26:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.642108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X............................................X] duration:
2.012341619s
FAIL (2025-08-14 01:25:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 01:25:39.185023141 (128h0m1.144120387s) [upload=133326]: Starting upload
Aug 14 01:25:39.185097117 (128h0m1.144194363s) [upload=133326]: Done starting upload
Aug 14 01:25:39.185201912 (128h0m1.144299148s) [upload=133326]: Uploading segments...
Aug 14 01:25:39.185429852 (128h0m1.144527097s) [upload=133326]: Got next segment. Inline: false
Aug 14 01:25:39.185479447 (128h0m1.144576694s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 01:25:39.185485593 (128h0m1.144582828s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 01:25:39.505204464 (128h0m1.464301719s) [seg_pos={0 0}, upload=133326]: Begin upload segment...
Aug 14 01:25:39.505290557 (128h0m1.464387813s) [seg_pos={0 0}, upload=133326]: Done begin upload segment.
Aug 14 01:25:39.505330530 (128h0m1.464427812s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505341200 (128h0m1.464438441s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505862315 (128h0m1.46495957s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.505886119 (128h0m1.464983374s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506372614 (128h0m1.465469863s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.506833542 (128h0m1.465930812s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507204213 (128h0m1.466301467s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507591054 (128h0m1.466688299s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.507943416 (128h0m1.467040673s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508345418 (128h0m1.467442666s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.508718973 (128h0m1.467816228s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509139450 (128h0m1.468236702s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509273376 (128h0m1.468370631s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.509758049 (128h0m1.468855301s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510231881 (128h0m1.469329141s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510425169 (128h0m1.469522448s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.510834818 (128h0m1.469932075s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:39.511227047 (128h0m1.470324302s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Uploading piece...
Aug 14 01:25:40.079686717 (128h0m2.038783968s) [upload=133326]: Next returned nil segment
Aug 14 01:25:40.079709535 (128h0m2.038806799s) [upload=133326]: Waiting for error group managing segments...
Aug 14 01:25:40.226631746 (128h0m2.185728997s) [noise=true , address=45.91.116.9:4266 , piece_id=2PKOEXILUIMSHEXLGLDNZ2FQCGFAVWSIM6HC2WLLCOVP6TJSZA4Q, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232231748 (128h0m2.191328987s) [noise=true , address=77.90.31.10:4522 , piece_id=532Q7Y6DISSUODS6UGG4IQIFEQDZOBCIDKQENSPKAAJZZR2A475A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.232656760 (128h0m2.191754006s) [noise=true , address=104.36.82.35:4603 , piece_id=4ZY5IR3M3O7SP6FPNN3T5VSPWVWUECE75QOHGTEAVBQJK2PWXHGQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.233220024 (128h0m2.192317255s) [noise=true , address=77.90.31.21:4885 , piece_id=KMW5PTBQOMWZZRAIQA2WIA6ZYM2KINSJYQ4S2DMC72R5AQ62YKDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.234923421 (128h0m2.194020668s) [noise=true , address=104.36.82.22:4534 , piece_id=MLSHDVTYGTZS2VHWWHPEEODMWHDYESAB2KTLAKPJTW2HEAFD7XCQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.236856350 (128h0m2.195953588s) [noise=true , address=77.90.31.17:4799 , piece_id=T2DQRMWX7QS5IRDHYUOVHIUPBCTGFGDSTE2QM6JJYMFCQ6AYAEQA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248445835 (128h0m2.207543087s) [noise=true , address=104.36.82.10:4100 , piece_id=DM575XPOQLDOCRAB4DUNZCNTEQHZYNGQSSR7WDOEDQOG6JHKNVVQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.248698438 (128h0m2.207795684s) [noise=true , address=104.36.82.6:4903 , piece_id=QTL2VRSQRGKWSRRHZTWIIZ37GIQU63BT7QFMNF3FHTXOEZ5OH5RA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.256213367 (128h0m2.215310624s) [noise=true , address=104.36.82.18:4393 , piece_id=KVE3PVDALAJIJIZS3PDHHOYFAMS3C4EIA2GYQ7BJAFYPTSGWTFZQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.263321060 (128h0m2.222418306s) [noise=true , address=104.36.82.37:4676 , piece_id=ZT2BJ5TGSMNOEZP55OA5YBNV73A57KEC4G3ELXBOQTBXE6EJOLZA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.265210041 (128h0m2.224307276s) [noise=true , address=104.36.82.59:4334 , piece_id=FXJIHLOH7JBBQI3FUFD23HUFIJLT5CRPA42XZDTKQMTH6OFVOVDQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.266319081 (128h0m2.225416332s) [noise=true , address=104.36.82.2:4752 , piece_id=2NJCJY7CQTNWC6TESYHJHFOYID2IEB2DVP275CX6MTANSRRL3MDA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.268508654 (128h0m2.227605886s) [noise=true , address=104.36.82.8:4992 , piece_id=MUIL2UQZI2DBPXQUTEQIWIZBATNE5HVG5UTUXFIS4MC54IWSWX4A, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269361789 (128h0m2.228459053s) [noise=true , address=104.36.82.50:4032 , piece_id=3NL6T445PFWJ763U6VXU5QQXGDAAJBJBO77VZ5YDATDKRW2IKQVA, seg_pos={0 0}, upload=133326]: Done uploading piece. err: <nil>
Aug 14 01:25:40.269381029 (128h0m2.228478265s) [seg_pos={0 0}, upload=133326]: Segment reached optimal threshold of 14 pieces.
Aug 14 01:25:40.269524038 (128h0m2.228621289s) [noise=true , address=77.90.31.11:4561 , piece_id=XEHSRVLFT2RUYAEOH5UTQRWAVBTH2CT6V45CIAJ7QRKPJ7OFIGJQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bkhuJ5T8SgGFMn6vv6wWnHiJarcMgVuhk6JNmNZoskzwP1gVi): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269651867 (128h0m2.228749114s) [noise=true , address=104.36.82.16:4313 , piece_id=3UYQBYJFFL4Y7UDHANZI7VNHHEEBMWWA55YKASUOVKOVEOYMNUUQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 14 01:25:40.269981339 (128h0m2.229078597s) [noise=true , address=66.23.193.175:4555 , piece_id=4XONM5VAOIBHF7Q62BV535BWHHC3IN53NMUPVTK4Q3V3SDCA4TOQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40348->66.23.193.175:4555: use of closed network connection
Aug 14 01:25:40.270079432 (128h0m2.229176684s) [noise=true , address=64.49.13.169:4711 , piece_id=YTTC33XROTLKRC6TNYF7JWKNVZH2SWFWHXPAYWFOZO4G55YAXJKQ, seg_pos={0 0}, upload=133326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44882->64.49.13.169:4711: use of closed network connection
Aug 14 01:25:40.270097051 (128h0m2.229194303s) [seg_pos={0 0}, upload=133326]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 01:25:40.270182388 (128h0m2.22927964s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 01:25:40.270188303 (128h0m2.229285555s) [upload=133326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 01:25:40.596377153 (128h0m2.555474392s) [upload=133326]: Done uploading segments...
Aug 14 01:25:40.596400407 (128h0m2.555497654s) [upload=133326]: Upload finished. err: <nil>
Duration: 2.01237547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.511969291s
FAIL (2025-08-14 01:25:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.512000899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.....X..............] duration:
1.115462745s
FAIL (2025-08-14 01:25:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.11550166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.531086048s
FAIL (2025-08-14 01:24:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.531122689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.....X.............] duration:
1.212801402s
FAIL (2025-08-14 01:24:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.212841609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.333055838s
FAIL (2025-08-14 01:23:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.333079701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration:
983.144003ms
FAIL (2025-08-14 01:23:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 983.269867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.................X.........................................] duration:
2.466229114s
FAIL (2025-08-14 01:22:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.466264949s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration:
1.049859434s
FAIL (2025-08-14 01:22:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.049911375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.................X........................................] duration:
2.38922025s
FAIL (2025-08-14 01:21:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.38931568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.....X..........] duration:
849.316108ms
FAIL (2025-08-14 01:21:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.356402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.X.................X.......................................] duration:
2.519126011s
FAIL (2025-08-14 01:21:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.519162035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.X.................X......................................] duration:
2.448110291s
FAIL (2025-08-14 01:20:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.44814626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.....X.........] duration:
836.240298ms
FAIL (2025-08-14 01:20:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.278091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.X.................X.....................................] duration:
2.597880591s
FAIL (2025-08-14 01:19:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.598001958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.....X........] duration:
867.933954ms
FAIL (2025-08-14 01:19:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.971221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.X.................X....................................] duration:
2.48790636s
FAIL (2025-08-14 01:18:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.487949291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.....X.......] duration:
830.739585ms
FAIL (2025-08-14 01:18:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.767672ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.....X......] duration:
1.012305448s
FAIL (2025-08-14 01:18:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.012339752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.X.................X...................................] duration:
2.601801491s
FAIL (2025-08-14 01:17:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.601833178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.....X.....] duration:
906.29541ms
FAIL (2025-08-14 01:17:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 906.326248ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X.................X..................................] duration:
2.983296232s
FAIL (2025-08-14 01:16:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.98340544s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.....X....] duration:
1.16259772s
FAIL (2025-08-14 01:16:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.162638804s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.X.................X.................................] duration:
2.517724032s
FAIL (2025-08-14 01:15:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.517757974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.....X...] duration:
861.096332ms
FAIL (2025-08-14 01:15:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.147999ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.....X..] duration:
897.162037ms
FAIL (2025-08-14 01:14:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 897.199216ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.X.................X................................] duration:
2.412875529s
FAIL (2025-08-14 01:14:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.412918294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X.....X.] duration:
987.856679ms
FAIL (2025-08-14 01:13:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 987.907428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.X.................X...............................] duration:
2.644053317s
FAIL (2025-08-14 01:13:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.644101196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.....X] duration:
362.119974ms
FAIL (2025-08-14 01:13:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 01:13:26.402062005 (127h47m48.361159241s) [upload=133126]: Starting upload Aug 14 01:13:26.402124529 (127h47m48.361221779s) [upload=133126]: Done starting upload Aug 14 01:13:26.402197128 (127h47m48.361294364s) [upload=133126]: Uploading segments... Aug 14 01:13:26.402255455 (127h47m48.361352709s) [upload=133126]: Got next segment. Inline: true Aug 14 01:13:26.402261286 (127h47m48.361358533s) [upload=133126]: Waiting for error group managing segments... Aug 14 01:13:26.402302654 (127h47m48.3613999s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:13:26.402307377 (127h47m48.361404625s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:13:26.402313617 (127h47m48.361410866s) [upload=133126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:13:26.491235728 (127h47m48.450332973s) [upload=133126]: Done uploading segments... Aug 14 01:13:26.491274518 (127h47m48.450371776s) [upload=133126]: Upload finished. err: metaclient: Too Many Requests
Duration: 362.160615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
905.001989ms
FAIL (2025-08-14 01:13:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 905.033156ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.X.................X..............................] duration:
2.535435163s
FAIL (2025-08-14 01:12:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.535476221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.X.................X.............................] duration:
2.426370333s
FAIL (2025-08-14 01:12:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.426485278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
870.807926ms
FAIL (2025-08-14 01:12:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 870.859539ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.X.................X............................] duration:
2.581375141s
FAIL (2025-08-14 01:11:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.581402464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.086858956s
FAIL (2025-08-14 01:11:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 1.086886714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.X.................X...........................] duration:
2.376829997s
FAIL (2025-08-14 01:11:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.376868659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.031908698s
FAIL (2025-08-14 01:10:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 1.031936643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.X.................X..........................] duration:
2.391862466s
FAIL (2025-08-14 01:10:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.391899757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.326200527s
FAIL (2025-08-14 01:10:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 1.326231771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.X.................X.........................] duration:
2.578435337s
FAIL (2025-08-14 01:09:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.578476356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.X.................X........................] duration:
2.683542643s
FAIL (2025-08-14 01:09:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.683576585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
632.279119ms
FAIL (2025-08-14 01:08:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 01:08:52.154468455 (127h43m14.113565703s) [upload=133049]: Starting upload Aug 14 01:08:52.154577448 (127h43m14.113674703s) [upload=133049]: Done starting upload Aug 14 01:08:52.154691362 (127h43m14.113788599s) [upload=133049]: Uploading segments... Aug 14 01:08:52.154744062 (127h43m14.113841316s) [upload=133049]: Got next segment. Inline: true Aug 14 01:08:52.154750694 (127h43m14.113847939s) [upload=133049]: Waiting for error group managing segments... Aug 14 01:08:52.154795378 (127h43m14.113892623s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 01:08:52.154800653 (127h43m14.113897898s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 01:08:52.154804547 (127h43m14.113901793s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 01:08:52.317363181 (127h43m14.276460435s) [upload=133049]: Done uploading segments... Aug 14 01:08:52.317423312 (127h43m14.276520559s) [upload=133049]: Upload finished. err: <nil>
Duration: 632.315642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.X.................X.......................] duration:
2.417046688s
FAIL (2025-08-14 01:08:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.417081344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.X.................X......................] duration:
2.500053792s
FAIL (2025-08-14 01:08:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 00:51:34.875183385 (127h25m56.83428062s) [upload=132750]: Starting upload
Aug 14 00:51:34.875244844 (127h25m56.834342089s) [upload=132750]: Done starting upload
Aug 14 00:51:34.875363046 (127h25m56.834460285s) [upload=132750]: Uploading segments...
Aug 14 00:51:34.875594754 (127h25m56.834692s) [upload=132750]: Got next segment. Inline: false
Aug 14 00:51:34.875651960 (127h25m56.834749205s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 00:51:34.875656657 (127h25m56.834753889s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 00:51:35.084275865 (127h25m57.04337311s) [seg_pos={0 0}, upload=132750]: Begin upload segment...
Aug 14 00:51:35.084340683 (127h25m57.043437928s) [seg_pos={0 0}, upload=132750]: Done begin upload segment.
Aug 14 00:51:35.084378804 (127h25m57.043476057s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084398148 (127h25m57.043495393s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084490697 (127h25m57.043587941s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084740462 (127h25m57.043837707s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084796671 (127h25m57.043893916s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.084993084 (127h25m57.044090333s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085101877 (127h25m57.044199123s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085244057 (127h25m57.044341289s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085404794 (127h25m57.044502038s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085500431 (127h25m57.044597676s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085718245 (127h25m57.044815493s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.085741148 (127h25m57.044838392s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086000098 (127h25m57.04509733s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086052037 (127h25m57.045149282s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086326450 (127h25m57.045423695s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086620782 (127h25m57.045718029s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.086911317 (127h25m57.046008618s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.087208486 (127h25m57.046305734s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Uploading piece...
Aug 14 00:51:35.659085368 (127h25m57.618182607s) [upload=132750]: Next returned nil segment
Aug 14 00:51:35.659108213 (127h25m57.618205469s) [upload=132750]: Waiting for error group managing segments...
Aug 14 00:51:35.795710951 (127h25m57.754808209s) [noise=true , address=77.90.31.10:4547 , piece_id=HXJUQRNI5S73YS77275UEZO2DFFWBOIIHPVQYW4APLPVZTQD5BRQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.805730843 (127h25m57.764828087s) [noise=true , address=79.127.219.38:4035 , piece_id=H6A2IRE3ZBB7W574KMWQSZNLYOSBEA5GGN4EY63DQCABPOOTVFUQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.823225984 (127h25m57.782323224s) [noise=true , address=104.36.82.53:4135 , piece_id=OEPYIWNMV6VGVBW3D3X7XY462OOY2AZFGUW5TVKSQIWMFPVBL4KA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830732163 (127h25m57.789829402s) [noise=true , address=104.36.82.62:4420 , piece_id=EC2RMEDWZF7JIF2IGW4U3AK6UEAXQFLLPGXARIE3HQC7FSNPGHWA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.830787914 (127h25m57.789885148s) [noise=true , address=104.36.82.8:4984 , piece_id=SW6NR4QJWD5KAL2YASNIVKVTLMOGXETRUKRX3HHAPPCIURUPLMTA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.834094226 (127h25m57.793191465s) [noise=true , address=104.36.82.9:4017 , piece_id=FI6DPPUSPB2ASB7RDMVTV2K7HDT77NR75ZPB4URPT2GTQXV5H5WQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.838685250 (127h25m57.797782488s) [noise=true , address=104.36.82.39:4740 , piece_id=WOVNVO6RPDZXO6LVORJMUZDHWWVHM32V27AZKQV2FROVSMUSNF4Q, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.855492540 (127h25m57.814589779s) [noise=true , address=104.36.82.5:4848 , piece_id=QH3H7RERBFLFIZ6ESFK4SGBS3XG62NC7UFDUBLKTGLPW2SUBXGQQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.856251175 (127h25m57.815348412s) [noise=true , address=104.36.82.50:4024 , piece_id=KWHTS2H3WAQEWS2GCPIRE7GPEGN3F2CWJJJ3ZVDOLIYX3MO6KOEQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.880311481 (127h25m57.839408732s) [noise=true , address=104.36.82.61:4376 , piece_id=53BOA267P4O5PEQSAHM7X65YE64L7YBCWRJNV322NV5FOBR35XCQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.895955461 (127h25m57.855052713s) [noise=true , address=104.36.82.60:4350 , piece_id=V6BQUZMDIIB332GGZPKWIXDSKLY4QW22Q3X5BV4PZIH5DDAZGGJA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.898552386 (127h25m57.857649632s) [noise=true , address=104.36.82.47:4551 , piece_id=GB54YL2XL7FHLHAYXVFLKIGZBWKICGD3REASYUJYZB4JGI7P4SPQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.910335709 (127h25m57.869432941s) [noise=true , address=104.36.82.34:4563 , piece_id=KKLLKA3JDKKXVDPHPLK67MJTUZHFR24QLBH4B4ZAPDJ6ETOJTFVA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929878080 (127h25m57.888975318s) [noise=true , address=104.36.82.23:4459 , piece_id=F7553GF4H4YP5JJPBEAK4NEQTNAI4DGL53XURE2OJSUWQQFB4AIA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: <nil>
Aug 14 00:51:35.929942196 (127h25m57.889039441s) [seg_pos={0 0}, upload=132750]: Segment reached optimal threshold of 14 pieces.
Aug 14 00:51:35.930119133 (127h25m57.889216371s) [noise=true , address=79.127.201.215:4335 , piece_id=DFHHMK2UKNZZHDSKU7O3LWRT4RLHSTSKCKQQAUZLZFZ3JWZQZBDA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VvdWASvi36Tr8JZUfn6Uup2GQy8yYTLwjQ6gm5Teo2sNvB51c): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930208085 (127h25m57.889305332s) [noise=true , address=104.36.82.36:4642 , piece_id=BPORLRSBSULGQ6OZSVHGCHM7WFKTZA5IZCK3ZGJJHWPL2SQIS2UA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930264345 (127h25m57.889361582s) [noise=true , address=193.149.164.143:4693 , piece_id=BZEOLG3UZ3MHWK5M56AR76WWOBCAZEW24JMKQRNXXLK4MHD5FHIQ, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47356->193.149.164.143:4693: use of closed network connection
Aug 14 00:51:35.930331074 (127h25m57.889428312s) [noise=true , address=104.36.82.59:4324 , piece_id=OSXI2O3EETFDZOWJBNOGJ5352YUVKHGDR4FTZW3M32VSLT7ZBNQA, seg_pos={0 0}, upload=132750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 00:51:35.930357548 (127h25m57.889454784s) [seg_pos={0 0}, upload=132750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 00:51:35.930463129 (127h25m57.889560365s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 00:51:35.930473285 (127h25m57.889570527s) [upload=132750]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 00:51:36.188734300 (127h25m58.147831544s) [upload=132750]: Done uploading segments...
Aug 14 00:51:36.188757106 (127h25m58.147854357s) [upload=132750]: Upload finished. err: <nil>
Duration: 2.500085411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|