Proceedings of the 2nd International Seminar of Science and Applied Technology (ISSAT 2021)

Applying Hand Gesture Recognition for User Guide Application Using MediaPipe

Authors
Indriani1, Moh. Harris1, Ali Suryaperdana Agoes1, *
1Department of Informatics Engineering, STMIK AMIKBANDUNG, Bandung, Indonesia.
*Corresponding author. Email: ali@stmik-amikbandung.ac.id
Corresponding Author
Ali Suryaperdana Agoes
Available Online 23 November 2021.
DOI
10.2991/aer.k.211106.017How to use a DOI?
Keywords
Hand Gesture Recognition; MediaPipe; Kinect; User Guide Application
Abstract

Hand gesture recognition is considered important with development technology in industry 4.0 in Human-Computer-Interactions (HCI) which gives computers the competence to capture and interpret hand gestures the executing command without touching devices physically. The MediaPipe is present as a framework built-in machine learning that has a solution for a hand gesture recognition system. In this research, we develop a simple user guide application using the MediaPipe framework. The user guide is commonly known as documentation about technical communication or a manual in a certain system to assist people. The user guide has step-by-step descriptions about handling a particular system and helps the user deal with user frustration by giving them the means to be identified, understand, and disentangle technical problems that frequently occurred by themselves. In our experiment, we captured a real-time image using Kinect, then trained a variety of hand gesture data, identified each hand gesture, and recognized hand gestures to convey information based on hand gestures in the system user guide application. The user can archive information user guide based on hand gestures that have been recognized. We proposed using hand gesture recognition using MediaPipe in our application to improve the convenience of utilization the user guide application and change user guide application that is still manual become a more interactive application.

Copyright
© 2021 The Authors. Published by Atlantis Press International B.V.
Open Access
This is an open access article under the CC BY-NC license.

Download article (PDF)

Volume Title
Proceedings of the 2nd International Seminar of Science and Applied Technology (ISSAT 2021)
Series
Advances in Engineering Research
Publication Date
23 November 2021
ISBN
10.2991/aer.k.211106.017
ISSN
2352-5401
DOI
10.2991/aer.k.211106.017How to use a DOI?
Copyright
© 2021 The Authors. Published by Atlantis Press International B.V.
Open Access
This is an open access article under the CC BY-NC license.

Cite this article

TY  - CONF
AU  - Indriani
AU  - Moh. Harris
AU  - Ali Suryaperdana Agoes
PY  - 2021
DA  - 2021/11/23
TI  - Applying Hand Gesture Recognition for User Guide Application Using MediaPipe
BT  - Proceedings of the 2nd International Seminar of Science and Applied Technology (ISSAT 2021)
PB  - Atlantis Press
SP  - 101
EP  - 108
SN  - 2352-5401
UR  - https://doi.org/10.2991/aer.k.211106.017
DO  - 10.2991/aer.k.211106.017
ID  - 2021
ER  -