Multimodal Interface for Games: A Case Study with TinyML

Haoxuan Xie, Lam Chi Hou, Lap Tou Chau, Lei Ka Weng, Xichen Wang, Yuxuan Guo, Giovanni Delnevo, Chiara Ceccarini, Chan Tong Lam, Su Kit Tang

研究成果: Conference contribution同行評審

摘要

Multimodal interfaces go beyond the traditional interaction through keyboard and mouse by incorporating multiple modes of interaction, such as touch, voice, gesture, and even gaze, to create more intuitive and immersive user experiences. This paper investigates how TinyML can be employed for multimodal interfaces in the context of games. An endless game in which the character has to avoid obstacles and fight monsters to advance has been developed. An Arduino Nano 33 BLE Sense is then used as the input device for the game by recognizing the hand gestures of the players.

原文English
主出版物標題2024 IEEE 21st Consumer Communications and Networking Conference, CCNC 2024
發行者Institute of Electrical and Electronics Engineers Inc.
頁面823-826
頁數4
ISBN(電子)9798350304572
DOIs
出版狀態Published - 2024
事件21st IEEE Consumer Communications and Networking Conference, CCNC 2024 - Las Vegas, United States
持續時間: 6 1月 20249 1月 2024

出版系列

名字Proceedings - IEEE Consumer Communications and Networking Conference, CCNC
ISSN(列印)2331-9860

Conference

Conference21st IEEE Consumer Communications and Networking Conference, CCNC 2024
國家/地區United States
城市Las Vegas
期間6/01/249/01/24

指紋

深入研究「Multimodal Interface for Games: A Case Study with TinyML」主題。共同形成了獨特的指紋。

引用此