SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography

Author

Kimura, Naoki and Gemicioglu, Tan and Womack, Jonathan and Li, Richard and Zhao, Yuhui and Bedri, Abdelkareem and Su, Zixiong and Olwal, Alex and Rekimoto, Jun and Starner, Thad

Abstract

Speech is inappropriate in many situations, limiting when voice control can be used. Most unvoiced speech text entry systems can not be used while on-the-go due to movement artifacts. Using a dental retainer with capacitive touch sensors, SilentSpeller tracks tongue movement, enabling users to type by spelling words without voicing. SilentSpeller achieves an average 97% character accuracy in offline isolated word testing on a 1164-word dictionary. Walking has little effect on accuracy; average offline character accuracy was roughly equivalent on 107 phrases entered while walking (97.5%) or seated (96.5%). To demonstrate extensibility, the system was tested on 100 unseen words, leading to an average 94% accuracy. Live text entry speeds for seven participants averaged 37 words per minute at 87% accuracy. Comparing silent spelling to current practice suggests that SilentSpeller may be a viable alternative for silent mobile text entry.

DOI

https://doi.org/10.1145/3491102.3502015