A COMPUTER VISION BASED VIRTUAL HAND GESTURE RECOGNITION SYSTEM
DOI:
https://doi.org/10.63458/ijerst.v1i1.59Keywords:
Gesture-Based Input, Virtual Mouse Control, Virtual Keyboard ControlAbstract
Researchers are presently directing their efforts towards the development of devices characterized by reduced hardware dependencies. The domain of computer vision technology is experiencing a notable surge in advancement and innovation. Consequently, this article suggests the integration of hand gestures as an input modality to facilitate the creation of a virtual mouse and keyboard interface. The proposed method operates by utilizing a webcam to detect and interpret hand movements, allowing users to interact with the computer system without the need for physical hardware peripherals such as a mouse or keyboard. This virtual input system holds significant advantages, particularly in situations where physical device space is constrained. Notably, it mitigates issues related to battery consumption, which is often a concern in conventional input methods reliant on power-hungry hardware components. Furthermore, this innovative approach bears the potential to contribute to the containment of the rapid transmission of contagious agents, such as the Coronavirus, by reducing the need for physical contact with shared input devices. Additionally, this technology offers considerable utility to individuals who may face challenges when employing a traditional physical keyboard and mouse. Leveraging computer vision techniques, the virtual keyboard and mouse control system presented herein is designed to enhance user accessibility and usability, providing a more intuitive and adaptable interaction method.
.
References
Abedin, Md.Z., Nath, A.C., Dhar, P., Deb, K., Hossain, M.S., 2017. License plate recognition system based on contour properties and deep learning model, in: 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC). Presented at the 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), pp. 590–593. https://doi.org/10.1109/R10-HTC.2017.8289029
Ahmed, T.U., Hossain, S., Hossain, M.S., Ul Islam, R., Andersson, K., 2019. Facial Expression Recognition using Convolutional Neural Network with Data Augmentation, in: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR). Presented at the 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), IEEE, Spokane, WA, USA, pp. 336–341. https://doi.org/10.1109/ICIEV.2019.8858529
Ahmed, T.U., Jamil, M.N., Hossain, Mohammad Shahadat, Andersson, K., Hossain, Mohammed Sazzad, 2020. An Integrated Real-Time Deep Learning and Belief Rule Base Intelligent System to Assess Facial Expression Under Uncertainty, in: 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR). Presented at the 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR), IEEE, Kitakyushu, Japan, pp. 1–6. https://doi.org/10.1109/ICIEVicIVPR48672.2020.9306622
Asad, M.-U., Mustafa, R., Hossain, M., 2019. An Efficient Strategy for Face Clustering use in Video Surveillance System. https://doi.org/10.13140/RG.2.2.31972.42882
Bhuvana, D.S., Ashwin, E., Boopathi, R., Victor, A.D., 2017. Virtual Keyboard Interaction with System Based on Webcam. Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol. 2, 445–449. https://doi.org/10.32628/CSEIT1722157
Da Silva, R.A., Veiga, A.C.P., 2020. Algorithm for decoding visual gestures for an assistive virtual keyboard. IEEE Lat. Am. Trans. 18, 1909–1916. https://doi.org/10.1109/TLA.2020.9398632
Gupta, D., Hossain, E., Hossain, Mohammed Sazzad, Hossain, Mohammad Shahadat, Andersson, K., 2021. An Interactive Computer System with Gesture-Based Mouse and Keyboard, in: Vasant, P., Zelinka, I., Weber, G.-W. (Eds.), Intelligent Computing and Optimization, Advances in Intelligent Systems and Computing. Springer International Publishing, Cham, pp. 894–906. https://doi.org/10.1007/978-3-030-68154-8_76
Gupta, D., Hossain, E., Hossain, M.S., Andersson, K., Hossain, S., 2019. A Digital Personal Assistant using Bangla Voice Command Recognition and Face Detection, in: 2019 IEEE International Conference on Robotics, Automation, Artificial-Intelligence and Internet-of-Things (RAAICON). Presented at the 2019 IEEE International Conference on Robotics, Automation, Artificial-intelligence and Internet-of-Things (RAAICON), IEEE, Dhaka, Bangladesh, pp. 116– 121. https://doi.org/10.1109/RAAICON48939.2019.47
Hsieh, C.-C., Liou, D.-H., Lee, D., 2010. A real time hand gesture recognition system using motion history image, in: 2010 2nd International Conference on Signal Processing Systems. Presented at the 2010 2nd International Conference on Signal Processing Systems, pp. V2-394-V2-398. https://doi.org/10.1109/ICSPS.2010.5555462
Islam, Md.Z., Hossain, M.S., Ul Islam, R., Andersson, K., 2019. Static Hand Gesture Recognition using Convolutional Neural Network with Data Augmentation, in: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR). Presented at the 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), IEEE, Spokane, WA, USA, pp. 324–329. https://doi.org/10.1109/ICIEV.2019.8858563
Kumari, P., Singh, S., Pasi, V.K., 2016. Cursor Control using Hand Gestures. IJCA Proc. Recent Trends Future Prospect. Eng. Manag. Technol. RTFEM 2016, 25–29.
Mj, J., 2018. Finger recognition and gesture based augmented keyboard.
Patil, M.I.D., Lambhate, P.P.D., 2015. Virtual Keyboard Interaction Using Eye Gaze and Eye Blink. Int. J. Recent Innov. Trends Comput. Commun. 3, 4849–4852. https://doi.org/10.17762/ijritcc.v3i7.4750
Shibly, K., Dey, S., Islam, Md.A., Showrav, S., 2019. Design and Development of Hand Gesture Based Virtual Mouse. https://doi.org/10.1109/ICASERT.2019.8934612
Shriram, S., Nagaraj, B., Jaya, J., Shankar, S., Ajay, P., 2021. Deep Learning-Based Real-Time AI Virtual Mouse System Using Computer Vision to Avoid COVID-19 Spread. J. Healthc. Eng. 2021, e8133076. https://doi.org/10.1155/2021/8133076
Singh, J., Goel, Y., Jain, S., Yadav, S., 2022. Virtual Mouse And Assistant: A Technological Revolution Of Artificial Intelligence. J. Pharm. Negat. Results 13.
