Silent speech reviews first.
Naoki Kimura's homepage and the SSI expert-review database share one entry point.
Dr. Naoki Kimura
Naoki Kimura is Chief Research Scientist at Yahoo. He received his Ph.D. in Information Studies from The University of Tokyo, where he was advised by Jun Rekimoto and Thad Starner. This site is his personal and research homepage, and it also serves as an SSI expert-review database for silent speech papers.
Email · CV · HCI Reviews · Publications
Featured paper pages
SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography
SilentSpeller is a strong, rigorously tested SSI system that reframes silent speech as silent spelling, enabling large vocabulary, live text entry, and walking robustness with in-mouth electropalatography sensors.
SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks
A solid proof of concept that reconstructs speech audio from ultrasound for controlling unmodified smart speakers, showcasing important system design insight despite prototype limitations in latency, hardware bulk, and speaker dependency.
NasoVoce: A Nose-Mounted Low-Audibility Speech Interface for Always-Available Speech Interaction
A strong deployment-focused speech interface leveraging a novel nose-pad dual-sensor configuration and multimodal fusion to enable robust low-audibility speech interaction with AI under noise, backed by extensive evaluation.
Selected Publications
Gaze+Lip: Rapid, Expressive Interactions Combining Gaze Input and Silent Speech Commands for Hands-free Smart TV Control
ETRA 2021
Mobile, Hands-free, Silent Speech Texting Using SilentSpeller
CHI 2021 Interactivity
End-to-End Deep Learning Speech Recognition Model for Silent Speech Challenge
INTERSPEECH 2020 Show-and-Tell
Education
Ph.D. in Information Studies, The University of Tokyo
Graduate School of Interdisciplinary Information Studies. Advisors: Jun Rekimoto and Thad Starner.
Master's degree with highest distinction, The University of Tokyo
Information Studies, Graduate School of Interdisciplinary Information Studies.
BA in Urban Engineering, The University of Tokyo
Honors
Microsoft Research Asia Fellowship
Winner.
Microsoft Research Asia D-CORE
Winner.
JSPS Research Fellowship for Young Scientists DC2
Research fellowship noted in the 2021 CV.
JST ACT-X
Frontier of mathematics and information science.
Google PhD Fellowship
Winner.
ACM CHI Honorable Mention Award
For SottoVoce, top 5%.