Skip to main navigation Skip to search Skip to main content

Design and Implementation of an Intelligent Navigation System for the Visually Impaired Based on Multimodal Perception Fusion

  • Mingjing Huang
  • , Weifeng Hu
  • , Qingwen Long
  • , Guanxuan Chen
  • , Ngai Cheong
  • Guangdong Communication Polytechnic
  • Macao Polytechnic University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The increasing demand for independent mobility among visually impaired individuals, especially in complex urban environments, has highlighted the limitations of traditional assistive tools such as white canes and tactile paving. These conventional methods offer only basic spatial awareness and lack the capacity to adapt to dynamic obstacles or rapidly changing surroundings. In response, this study presents the design and development of a lightweight, embedded navigation system based on multimodal perception fusion. The system integrates visual, ultrasonic, and inertial sensing modules, orchestrated through an ST Microelectronics 32-bit Microcontroller (STM32), and employs compact deep learning models to enable real-time obstacle detection, semantic scene understanding, and user behavior monitoring. Additionally, it incorporates BeiDou satellite positioning and Global System for Mobile Communications (GSM) communication for continuous location tracking and emergency alerts, while a voice interaction interface ensures effective user feedback. Fall detection mechanisms are also embedded to enhance safety in unexpected situations. Experimental evaluation in real-world urban settings demonstrates that the system maintains stable performance, achieves positioning accuracy within 8 meters, and ensures a reliable runtime of approximately 8 hours on a single battery charge. These results validate the feasibility and effectiveness of integrating embedded AI and sensor fusion technologies to improve autonomous navigation capabilities for visually impaired users.

Original languageEnglish
Title of host publicationProceedings - 2025 International Conference on Advances in Electrical Engineering and Computer Applications, AEECA 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages444-448
Number of pages5
ISBN (Electronic)9798331594695
DOIs
Publication statusPublished - 2025
Event2025 6th International Conference on Advances in Electrical Engineering and Computer Applications, AEECA 2025 - Hybrid, Dalian, China
Duration: 22 Aug 202524 Aug 2025

Publication series

NameProceedings - 2025 International Conference on Advances in Electrical Engineering and Computer Applications, AEECA 2025

Conference

Conference2025 6th International Conference on Advances in Electrical Engineering and Computer Applications, AEECA 2025
Country/TerritoryChina
CityHybrid, Dalian
Period22/08/2524/08/25

Keywords

  • assistive mobility
  • computer vision
  • deep learning
  • embedded system
  • Sensor fusion

Fingerprint

Dive into the research topics of 'Design and Implementation of an Intelligent Navigation System for the Visually Impaired Based on Multimodal Perception Fusion'. Together they form a unique fingerprint.

Cite this