Sensor Enabled Proximity Detection with Hybridisation of IoT and Computer Vision Models to Assist the Visually Impaired
Received: 18 September 2023 | Revised: 8 October 2023 | Accepted: 16 October 2023 | Online: 5 December 2023
Corresponding author: S. Sajini
Abstract
Proximity Detection Systems (PDS) are used to detect objects or persons close to Visually Impaired (VI) persons. Sensors are used to identify proximity based on the distance from objects. This study aimed to design a hybrid proximity detection framework for VI people using ultrasonic sensors embedded in a Raspberry Pi board to detect the proximity of a VI user in an office environment. Hybridization was based on the integration of IoT-enabled devices, ultrasonic proximity sensors, and computer vision algorithms to control the detection of objects or people and inform the user with a voice message. The model framework was implemented with 100 samples and tested with 10 analyses in each sample. The results showed significant improvement in detecting the proximity of the objects with an accuracy of 98.7%, outperforming current PDS with good results in precision, range, obstacle recognition, false positives and negatives, response time, usability, durability, reliability, etc.
Keywords:
proximity detection systems, hybrid visually impaired proximity detection (HVIPD) algorithm, hybrid proximity detection for visually impaired framework, computer vision, hybrid IoT ultrasonic systemDownloads
References
K. M. Zuhaib, J. Iqbal, A. M. Bughio, S. A. A. S. Bukhari, and K. Kanwar, "Collision Avoidance of a Kinodynamically Constrained System from Passive Agents," Engineering, Technology & Applied Science Research, vol. 11, no. 1, pp. 6760–6765, Feb. 2021.
S. P. R. Shastri, R. R. Singh, and K. V. Ajetrao, "Nonuniform C-Band Loop Antenna: A New Approach for Future UWB Applications," Engineering, Technology & Applied Science Research, vol. 8, no. 5, pp. 3496–3501, Oct. 2018.
L. M. Dagsa, A. T. Demetillo, A. D. B. Balamad, E. R. J. Sajonia, G. L. Amper, and M. C. O. Virtudazo, "Development of an Automated Ticketing and Tracking System for the Monitoring of Surface Mine Hauling Operations," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8500–8505, Jun. 2022.
H. Yusefi and B. Helfield, "The influence of inter-bubble spacing on the resonance response of ultrasound contrast agent microbubbles," Ultrasonics Sonochemistry, vol. 90, Nov. 2022, Art. no. 106191.
V. Naycheva, L. Bogdanov, and N. Iliev, "Embedded System for Detecting Underwater Ultrasound," in 2022 XXXI International Scientific Conference Electronics (ET), Sozopol, Bulgaria, Sep. 2022, pp. 1–5.
X. Cao, L. Ren, and C. Sun, "Research on Obstacle Detection and Avoidance of Autonomous Underwater Vehicle Based on Forward-Looking Sonar," IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 11, pp. 9198–9208, Aug. 2023.
B. Kuriakose, R. Shrestha, and F. E. Sandnes, "Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review," IETE Technical Review, vol. 39, no. 1, pp. 3–18, Jan. 2022.
S. Maack, S. Küttenbaum, B. Bühling, and E. Niederleithinger, "Low frequency ultrasonic dataset for pulse echo object detection in an isotropic homogeneous medium as reference for heterogeneous materials in civil engineering," Data in Brief, vol. 42, Jun. 2022, Art. no. 108235.
K. Suthar, H. Parikh, H. Pandya, and M. Jivani, "The Development of an Alarm System Using Ultrasonic Sensors for Reducing Accidents for Side-By-Side Driving Alerts," in Proceedings of the 2nd International Conference on Electronics, Biomedical Engineering, and Health Informatics, Surabaya, Indonesia, 2022, pp. 515–527.
D. Wang et al., "Ultrafast Myocardial Principal Strain Ultrasound Elastography During Stress Tests: In Vitro Validation and In Vivo Feasibility," IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 69, no. 12, pp. 3284–3296, Sep. 2022.
K. Kavin Kumar, D. Pooventhan, S. Pranesh, and P. K. Sandeep, "Ultrasonic Sensor Based Automatic Power Saving- System," in 2023 2nd International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN), Villupuram, India, Apr. 2023, pp. 1–6.
Y. Wang, Y. Cai, H. Gong, and Y. S. Lee, "Design and 3D printing of waveguide-based ultrasonic longitudinal-torsional transducers for medical needle insertion," Sensors and Actuators A: Physical, vol. 344, Sep. 2022, Art. no. 113706.
L. Zhu, "Analyze the Advantages and Disadvantages of Different Sensors for Autonomous Vehicles," presented at the 2022 7th International Conference on Social Sciences and Economic Development (ICSSED 2022), Apr. 2022, pp. 1020–1024.
F. R. Hogan, J.-F. Tremblay, B. H. Baghi, M. Jenkin, K. Siddiqi, and G. Dudek, "Finger-STS: Combined Proximity and Tactile Sensing for Robotic Manipulation," IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10865–10872, Jul. 2022.
H. Chen, L. Hou, G. (Kevin) Zhang, and S. Wu, "Using Context-Guided data Augmentation, lightweight CNN, and proximity detection techniques to improve site safety monitoring under occlusion conditions," Safety Science, vol. 158, Feb. 2023, Art. no. 105958.
K. Singh, D. Kapoor, K. Thakur, A. Sharma, and X.-Z. Gao, "Computer-Vision Based Object Detection and Recognition for Service Robot in Indoor Environment," Computers, Materials & Continua, vol. 72, no. 1, pp. 197–213, 2022.
D. Tsiktsiris, A. Lalas, M. Dasygenis, K. Votis, and D. Tzovaras, "An Efficient Method for Addressing COVID-19 Proximity Related Issues in Autonomous Shuttles Public Transportation," in Artificial Intelligence Applications and Innovations, Hersonissos, Greece, 2022, pp. 170–179.
R. C. Reyes, M. J. Polinar, R. M. Dasalla, G. S. Zapanta, M. P. Melegrito, and R. R. Maaliw, "Computer Vision-Based Signature Forgery Detection System Using Deep Learning: A Supervised Learning Approach," in 2022 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India, Jul. 2022, pp. 1–6.
J. Docekal, J. Rozlivek, J. Matas, and M. Hoffmann, "Human Keypoint Detection for Close Proximity Human-Robot Interaction," in 2022 IEEE-RAS 21st International Conference on Humanoid Robots (Humanoids), Ginowan, Japan, Aug. 2022, pp. 450–457.
X. Li, L. Yan, L. Zhao, R. Martinez-Maldonado, and D. Gasevic, "CVPE: A Computer Vision Approach for Scalable and Privacy-Preserving Socio-spatial, Multimodal Learning Analytics," in LAK23: 13th International Learning Analytics and Knowledge Conference, Arlington, TX, USA, Nov. 2023, pp. 175–185.
Q. K. Luu, D. Q. Nguyen, N. H. Nguyen, and V. A. Ho, "Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensing," in 2023 IEEE International Conference on Soft Robotics (RoboSoft), Singapore, Apr. 2023, pp. 1–6.
N. Farheen, G. G. Jaman, and M. P. Schoen, "Object Detection and Navigation Strategy for Obstacle Avoidance Applied to Autonomous Wheel Chair Driving," in 2022 Intermountain Engineering, Technology and Computing (IETC), Orem, UT, USA, Feb. 2022, pp. 1–5.
C. D. Vo, D. A. Dang, and P. H. Le, "Development of Multi-Robotic Arm System for Sorting System Using Computer Vision," Journal of Robotics and Control (JRC), vol. 3, no. 5, pp. 690–698, Sep. 2022.
J. Pincott, P. W. Tien, S. Wei, and J. K. Calautit, "Indoor fire detection utilizing computer vision-based strategies," Journal of Building Engineering, vol. 61, Dec. 2022, Art. no. 105154.
X. Zhang, E. Izquierdo, and K. Chandramouli, "Critical Infrastructure Security Using Computer Vision Technologies," in Security Technologies and Social Implications, John Wiley & Sons, Ltd, 2022, pp. 149–180.
S. Antonov, M. Bogachev, P. Leyba, A. Sinitca, and D. Kaplun, "An Intelligent System for Video-Based Proximity Analysis," in Deep Learning Applications in Image Analysis, S. S. Roy, C. H. Hsu, and V. Kagita, Eds. Singapore: Springer Nature, 2023, pp. 89–112.
K. Patel and B. Parmar, "Assistive device using computer vision and image processing for visually impaired; review and current status," Disability and Rehabilitation: Assistive Technology, vol. 17, no. 3, pp. 290–297, Apr. 2022.
Y. Zhang, G. X. Ong, Z. Jin, C. M. Seah, and T. S. Chua, "The effects of urban greenway environment on recreational activities in tropical high-density Singapore: A computer vision approach," Urban Forestry & Urban Greening, vol. 75, Sep. 2022, Art. no. 127678.
E. J. Snider, S. I. Hernandez-Torres, G. Avital, and E. N. Boice, "Evaluation of an Object Detection Algorithm for Shrapnel and Development of a Triage Tool to Determine Injury Severity," Journal of Imaging, vol. 8, no. 9, Sep. 2022, Art. no. 252.
Downloads
How to Cite
License
Copyright (c) 2023 S. Sajini, B. Pushpa
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
