Wearable Real-time Air-writing System Employing KNN and Constrained Dynamic Time Warping

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

In the digital world, gesture recognition plays a crucial role in human-computer interaction (HCI). In this paper, we propose an innovative wearable air-writing system that allows users to write the English alphabet and Arabic numerals in free space without using any predefined gestures or rules. Based on an Inertial Measurement Unit (IMU), the proposed air-writing wearable device uses the constrained dynamic time warping (cDTW) algorithm for the distance measure and K-nearest neighbors (KNN) as the classifier. In addition, to increase the recognition accuracy and meet HCI requirements, we develop a novel method that allows users to rapidly switch to correct recognition results when the initial results are erroneous. In the experiment, the accuracy rate is 88.9% for the alphabet and 10 decimal digits in the user-dependent condition, and the recognition is in real-time, consuming only 0.427s for each character, which is superior to many other approaches that employ classic DTW or FastDTW. With the proposed HCI design, character input accuracy of over 95% can be obtained in about 1 second. We also simulated the application scenarios of Parkinson's disease patients and obtained a high accuracy rate of 85.4%. Besides, we explored the variety of K values in KNN and w values in cDTW, and propose a multi-template system that gives new optimization directions for the KNN-cDTW algorithm.

Original languageEnglish
Title of host publication2023 IEEE Wireless Communications and Networking Conference, WCNC 2023 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665491228
DOIs
Publication statusPublished - 2023
Event2023 IEEE Wireless Communications and Networking Conference, WCNC 2023 - Glasgow, United Kingdom
Duration: 26 Mar 202329 Mar 2023

Publication series

NameIEEE Wireless Communications and Networking Conference, WCNC
Volume2023-March
ISSN (Print)1525-3511

Conference

Conference2023 IEEE Wireless Communications and Networking Conference, WCNC 2023
Country/TerritoryUnited Kingdom
CityGlasgow
Period26/03/2329/03/23

Keywords

  • HCI
  • accessibility
  • air-writing
  • dynamic time warping
  • gesture recognition
  • inertial sensor
  • wearable devices

Fingerprint

Dive into the research topics of 'Wearable Real-time Air-writing System Employing KNN and Constrained Dynamic Time Warping'. Together they form a unique fingerprint.

Cite this