[Preview] Demonstrating TapType for mobile ten-finger text entry anywhere
Paul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier, Hugo Romat, Christian Holz
CHI'22: ACM Conference on Human Factors in Computing Systems
Session: Interactivity
Abstract
We demonstrate a mobile text entry system that brings full-size ten-finger typing to everyday surfaces, allowing users to type anywhere. Our wearable wristband TapType integrates accelerometers that sense vibrations arising from finger taps against a passive surface, from which our Bayesian neural network estimates a probability distribution over the fingers of the hand. Given a pre-defined key-finger mapping, our text entry decoder fuses these predictions with the character priors of an n-gram language model to decode the input text entered by the user. TapType combines high portability with sustained rapid bimanual input across the full space, which we demonstrate at the example of supplementing text input on mobile touch devices, in eyes-free scenarios using audio feedback, and in a situated Mixed Reality scenario to enable typing outside visual control with passive haptic feedback.
WEB:: https://programs.sigchi.org/chi/2022/program/content/72143
Presentation Video:: https://www.youtube.com/watch?v=pLpsqo6Hxb0
DOI:: https://doi.org/10.1145/3491101.3519900
Video previews for CHI 2022 Interactivity