Location
Hilton Waikoloa Village, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
7-1-2025 12:00 AM
End Date
10-1-2025 12:00 AM
Description
Hands-free interfaces have become increasingly popular due to the growing demands for convenient interaction with mobile and wearable devices. Among all of hands-free interfaces, head gesture interaction has shown great potential in providing alternatives in various real-world scenarios, such as interfaces for people with disabilities and Virtual/Augmented Reality applications. However, existing head gesture recognition systems require either Line-Of-Sight or specialized/customized hardware. Additionally, some approaches could raise potential privacy concerns. In this work, we propose CochlearMotion, a novel in-ear wearable system that achieves head gesture recognition by utilizing off-the-shelf earbuds with a built-in microphone. Specifically, we leverage sonar-like techniques to sense the unique deformation of the ear canal, which closely correlated with each head motion for cross-user head gesture recognition. Our extensive experimental evaluation shows that our system can achieve over 95% recognition accuracy for six typical head gestures and works well in various real-world environments and scenarios.
Recommended Citation
Lee, Youngone; Tan, Sheng; and Wang, Zi, "CochlearMotion: Head Gesture Recognition Leveraging Ear Canal Deformation Sensing" (2025). Hawaii International Conference on System Sciences 2025 (HICSS-58). 2.
https://aisel.aisnet.org/hicss-58/in/hci/2
CochlearMotion: Head Gesture Recognition Leveraging Ear Canal Deformation Sensing
Hilton Waikoloa Village, Hawaii
Hands-free interfaces have become increasingly popular due to the growing demands for convenient interaction with mobile and wearable devices. Among all of hands-free interfaces, head gesture interaction has shown great potential in providing alternatives in various real-world scenarios, such as interfaces for people with disabilities and Virtual/Augmented Reality applications. However, existing head gesture recognition systems require either Line-Of-Sight or specialized/customized hardware. Additionally, some approaches could raise potential privacy concerns. In this work, we propose CochlearMotion, a novel in-ear wearable system that achieves head gesture recognition by utilizing off-the-shelf earbuds with a built-in microphone. Specifically, we leverage sonar-like techniques to sense the unique deformation of the ear canal, which closely correlated with each head motion for cross-user head gesture recognition. Our extensive experimental evaluation shows that our system can achieve over 95% recognition accuracy for six typical head gestures and works well in various real-world environments and scenarios.
https://aisel.aisnet.org/hicss-58/in/hci/2