TinyML-Based Object Detection on Smart Blind Stick for Visually Impaired Person

Closed

Parama Diptya Widayaka, Pradini Puspitaningayu, Sayyidul Aulia Alamsyah, Endryansyah Endryansyah, Lusia Rakhmawati, Paramitha Nerisafitra, Rifqi Abdillah, Akbar Wildhanata, Haikal Alif Eyrlangga

2025 2025 8th International Conference on Vocational Education and Electrical Engineering: Shaping a Sustainable Future with Green Innovation and Industry Collaboration for Education and Intelligent Technology Advancements, ICVEE 2025 Conference paper Cited by 0 Quartile

Abstract

In our daily life, we often find people with certain disabilities or certain physical limitations, such as visually impaired people. People with visual impairment often require assistance from others to perform daily activities. We have seen people with visual impairment using walking sticks to help them walk on the street or pedestrian. With the development of technologies, many studies have been conducted to create disability aids or assistive technology for people with disabilities, especially smart blind sticks with function to detect objects in front of people with limited vision, where the smart blind stick is equipped with a sensor to detect the presence of an obstacle in front of them. However, these aids are still limited to detect the presence of an object by identifying the type of the object. In this study, a smart blind stick system was created by implementing artificial intelligence to detect objects in front of people with visual impairment, where this system applies Tiny-ML that can be implemented on edge devices such as microcontrollers. In the results of this study, the system works well to recognize objects such as cars, motorcycles, road separators, and tactile guides in front of people with visual impairment by an F1 score of 78.1 percent. This object detection also gives a good result from hardware implementation with inferencing time 1368ms, 119.4K peak ram usage, and 90.2K flash usage. © 2025 IEEE.

Affiliations

Universitas Negeri Surabaya, Dept. of Electrical Engineering, Surabaya, Indonesia; Universitas Negeri Surabaya, Dept. of Informatics Engineering, Surabaya, Indonesia