Smart Assistive Shoes for Blind People Based on IoT

Abstract

Innovations that help people with special needs are among the most important services scientific research can provide to serve societies. From this standpoint, the idea behind this work is to help blind and visually impaired people live their lives normally. For example, it is difficult for blind people to walk independently; they must rely on others in most of their daily activities. Walking on the streets is one of the most difficult problems that blind people face, as they cannot notice every obstacle on the road using a cane. From this perspective, the proposed model in this work served this sector of society and made it more effective. The model presented in our work includes designing a smart shoe based on Internet of Things technologies, a Mobile App, sensors, Raspberry Pi microcontrollers, a camera, and an integrated alarm device. The smart shoe offers a long-term solution for the visually impaired. Moreover, it will allow them to reach their destination without stress and independently. The model was tested under different conditions, and the results were satisfactory, as the accuracy reached 80%.

Keywords

TensorFlow / IoT / Raspberry Pi / mobile app / Firebase

References

[1] He, Y., Nie, A., Pei, J., Ji, Z., Jia, J., Liu, H., . . . , & Wang, X. (2020). Prevalence and causes of visual impairment in population more than 50 years old: The Shaanxi eye study. Medicine , 99(20), e20109. https://doi.org/10.1097/MD.0000000000020109

[2] Vijeesh, V., Kaliappan, E., Ponkarthika, B., & Vignesh, G. (2019). Design of wearable shoe for blind using LIFI Technology. International Journal of Engineering and Advanced Technology, 8(6S3), 1398-1401. https://doi.org/10.35940/ijeat.f1248.0986s319

[3] Alotaibi, H., Javed, R., Alghannam, M. S., Saqer, M. F., & Al—Qahtani, M. (2022). Smart shoe gadget for visually impaired people. European Journal of Applied Sciences, 10(2), 253-258. https://doi.org/10.14738/aivp.102.11975

[4] Zou, Y., Libanori, A., Xu, J., Nashalian, A., & Chen, J. (2020). Triboelectric nanogenerator enabled smart shoes for wearable electricity generation. Research, 2020, 7158953. https://doi.org/10.34133/2020/7158953

[5] Abdul Jawwad, A. K., Turab, N., Al—Mahadin, G., Owida, H. A., & Al—Nabulsi, J. (2024). A perspective on smart universities as being downsized smart cities: A technological view of internet of things and big data. Indonesian Journal of Electrical Engineering and Computer Science, 35(2), 1162-1170. https://doi.org/10.11591/ijeecs.v35.i2.pp1162-1170

[6] Alhija, M. A., Al—Baik, O., Hussein, A., & Abdeljaber, H. (2024). Optimizing blockchain for healthcare IoT: A practical guide to navigating scalability, privacy, and efficiency trade—offs. Indonesian Journal of Electrical Engineering and Computer Science, 35(3), 1773-1785. https://doi.org/10.11591/ijeecs.v35.i3.pp1773-1785

[7] Parihar, V., Rohilla, Y., & Kumari, K. (2020). Ultrasonic sensor based smart cap as electronic travel aid for blind people. In 2020 Third International Conference on Smart Systems and Inventive Technology, 873-877. https://doi.org/10.1109/ICSSIT48917.2020.9214226

[8] Bhuniya, A., Laha, S., Maity, D. K., Sarkar, A., & Bhattacharyya, S. (2017). Smart glass for blind people. AMSE Journal, 38(1), 102-110.

[9] Das, T., Das, S., Nandi, J., Dutta, M., Purkayastha, A., Banerjee, A., & Ghosh, A. (2022). Smart blind stick. In Advanced Energy and Control Systems: Select Proceedings of 3rd International Conference, 157-166. https://doi.org/10.1007/978-981-16-7274-3_13

[10] Abu—Faraj, Z. O., Jabbour, E., Ibrahim, P., & Ghaoui, A. (2012). Design and development of a prototype rehabilitative shoes and spectacles for the blind. In 2012 5th International Conference on Biomedical Engineering and Informatics, 795-799. https://doi.org/10.1109/BMEI.2012.6513135

[11] Maduri, P. K., Kaushal, A., Khan, M. N., Rai, A. K., Khan, M. S., & Rameshwar, C. S. (2021). Realtime aid for blind using Python. In 2021 3rd International Conference on Advances in Computing, Communication Control and Networking, 1660-1664. https://doi.org/10.1109/ICAC3N53548.2021.9725785

[12] Bhongade, P., Girhay, S., Sheikh, A. M., Ghata, R., Ambadkar, S., & Dusane, C. (2022). Internet of Things—Enabled smart shoes for blind people. In 2022 IEEE Delhi Section Conference, 1-9. https://doi.org/10.1109/DELCON54057.2022.9753526

[13] Eskofier, B. M., Lee, S. I., Baron, M., Simon, A., Martindale, C. F., Gaßner, H., & Klucken, J. (2017). An overview of smart shoes in the internet of health things: Gait and mobility assessment in health promotion and disease monitoring. Applied Sciences, 7(10), 986. https://doi.org/10.3390/app7100986

[14] Al—Kababji, A., Shidqi, L., Boukhennoufa, I., Amira, A., Bensaali, F., Gastli, M. S., . . . , & Abdalla, A. (2019). IoT—based fall and ECG monitoring system: Wireless communication system based firebase realtime database. In 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, 1480-1485. https://doi.org/10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00267

[15] Saravanakumar, C., Subhashini, N., & James, K. (2023). SmartSense: An intelligent assistive system for typhlotic individuals using Raspberry Pi. In 2023 International Conference on System, Computation, Automation and Networking, 1-5. https://doi.org/10.1109/ICSCAN58655.2023.10394692

[16] Pardasani, A., Indi, P. N., Banerjee, S., Kamal, A., & Garg, V. (2019). Smart assistive navigation devices for visually impaired people. In 2019 IEEE 4th International Conference on Computer and Communication Systems, 725-729. https://doi.org/10.1109/CCOMS.2019.8821654

[17] Last Minute Engineers . (2024). How HC—SR04 ultrasonic sensor works & how to interface it with Arduino . https://lastminuteengineers.com/arduino-sr04-ultrasonic-sensor-tutorial/

[18] Wilkinson, M., Bell, M. C., & Morison, J. I. L. (2021). A Raspberry Pi—based camera system and image processing procedure for low cost and long—term monitoring of forest canopy dynamics. Methods in Ecology and Evolution, 12(7), 1316-1322. https://doi.org/10.1111/2041-210X.13610

[19] Altayeb, M., & Al—Ghraibah, A. (2022). Voice controlled camera assisted pick and place robot using Raspberry Pi. Indonesian Journal of Electrical Engineering and Informatics, 10(1), 51-59. http://doi.org/10.52549/ijeei.v10i1.3636

[20] Nishajith, A., Nivedha, J., Nair, S. S., & Shaffi, J. M. (2018). Smart cap—Wearable visual guidance system for blind. In 2018 International Conference on Inventive Research in Computing Applications, 275-278. https://doi.org/10.1109/ICIRCA.2018.8597327

[21] Zhang, X., Ma, X., Yan, J., Cui, B., Yan, J., & Zhang, J. (2022). Improving test case generation for Python native libraries through constraints on input data structures . arXiv. https://doi.org/10.48550/arXiv.2206.13828

[22] Johnson, F., McQuistin, S., & O’Donnell, J. (2020). Analysis of student misconceptions using Python as an introductory programming language. In Proceedings of the 4th Conference on Computing Education Practice, 1-4. https://doi.org/10.1145/3372356.3372360

[23] Ayer, V. M., Miguez, S., & Toby, B. H. (2014). Why scientists should learn to program in Python. Powder Diffraction, 29(S2), S48-S64. https://doi.org/10.1017/S0885715614000931

[24] DiMarzio, J. F. (2016). Beginning Android programming with Android Studio . USA: John Wiley & Sons. https://doi.org/10.1002/9781119419334

[25] Qodirov, F., Sirojev, N., & Negmatova, S. (2023). Features of the Android Studio software package. Academic Research in Modern Science, 2(17), 130-146. https://doi.org/10.5281/zenodo.8050543

[26] Jemerov, D., & Isakova, S. (2017). Kotlin in action . USA: Manning Publications.